design

DDD

Poison Pill

Pthreads ProgrammingChapter 2 - Designing Threaded Programs

Coding guidelines

Writing a Compiler in Rust - Tristan Hume

How we designed Dropbox ATF: an async task framework - Dropbox

Consistent Core

gRPC performance improvements in .NET 5 - .NET Blog

When to add context to errors | Efe’s Blog

Why Go Was the Right Choice for CockroachDB

How to Build an Exchange - YouTube

Throughput Formulas

Jane Street Tech Blog - Magic-trace: Diagnosing tricky performance issues easily with Intel Processor Trace

BurntSushi/ripgrep: ripgrep recursively searches directories for a regex pattern while respecting your gitignore

theogilbert/spv: Terminal-based process monitoring tool

Concurrency Freaks

iCloud Private Relay Overview

iCloud Private Relay Overview

L4Drop: XDP DDoS Mitigations

[BPF

BPF and XDP Reference Guide — Cilium 1.12.90 documentation

A deep-dive into Cloudflare’s autonomous edge DDoS protection

How we migrated Dropbox from Nginx to Envoy - Dropbox

How we built Pingora, the proxy that connects Cloudflare to the Internet

Production ready eBPF, or how we fixed the BSD socket API

Branch predictor: How many “if”s are too many? Including x86 and M1 benchmarks!

Cloudflare architecture and how BPF eats the world

Marek Majkowski - The Cloudflare Blog (Page 2)

The rise of multivector DDoS attacks

How to drop 10 million packets per second

rakelimit.pdf

Building a Continuous Profiler Part 3: Optimizing for Prod Systems | Pixie Labs Blog

BPF ring buffer

The Infrastructure Behind Twitter: Scale

RocksDB Tuning Guide · facebook/rocksdb Wiki

Adopting RocksDB within Manhattan

[c

Uber’s Next Gen Push Platform on gRPC | Uber Blog

CRISP: Critical Path Analysis for Microservice Architectures | Uber Blog

Is sequential IO dead in the era of the NVMe drive? — Jack Vanlightly

eBPF Instruction Set — The Linux Kernel documentation

Unit Testing eBPF Programs | a.programming.blog

Harnessing the eBPF Verifier | Trail of Bits Blog

A debugging story: corrupt packets in AF_XDP; a kernel bug or user error?

https://www.rfc-editor.org/rfc/rfc896.txt

heavy hitters.pdf

Unbounded memory usage by TCP for receive buffers, and how we fixed it

Optimizing TCP for high WAN throughput while preserving low latency

Debugging a FUSE deadlock in the Linux kernel | by Netflix Technology Blog | May, 2023 | Netflix TechBlog

Uncovering the Path of a Network Packet: From Hardware to User-Space Programs | by Teodor J. Podobnik, @dorkamotorka | Medium

The little book about OS development

Every request, every microsecond: scalable machine learning at Cloudflare

concurency permutation testing

Introducing Quicksilver: Configuration Distribution at Internet Scale

linux cfs

Multi-queue improvements in Linux kernel Ethernet driver mvneta - Bootlin’s blog

Basic System Design for Uber or Lyft | System Design Interview Prep - YouTube

Nginx Internals

reading todo

Kafka is dead, long live Kafka - WarpStream

[Unimog

Secure Multi-Tenancy in Apache Ozone | by Prashant Pogde | Aug, 2023 | Medium

Linux Networking Part 1 : Kernel Net Stack - DEV Community

Writing an OS in Rust

Introducing Immortal Objects for Python - Engineering at Meta

S3-FIFO queues cache eviction

record replay retroaction

Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications - Meta Research

Oxide Computer Company

How it works: The novel HTTP/2 ‘Rapid Reset’ DDoS attack | Google Cloud Blog

HTTP/2 Zero-Day Vulnerability Results in Record-Breaking DDoS Attacks

HTTP/2 Rapid Reset: deconstructing the record-breaking attack

UnderstandQUIC.pdf

Maximal extractable value (MEV) | ethereum.org

How To Build a MEV Bot • DeGatchi

Learning Iconic Scenes with Differential Privacy - Apple Machine Learning Research

Network-Centric Distributed Tracing with DeepFlow: Troubleshooting Your Microservices in Zero Code

Open-sourcing Katran, a scalable network load balancer - Engineering at Meta

Netdev | Netdev 2.1

3D Graphics: Crash Course Computer Science #27 - YouTube

Paper Notes: Finding a needle in Haystack – Facebook’s photo storage – Distributed Computing Musings

kernel parallel programming

performance

Branch Prediction

(1) Where should I start if I want to squeeze out as much performance as I can from my rust code? : rust

Rust Performance Pitfalls — Llogiq on stuff

Cheap tricks for high-performance Rust - Pascal’s Scribbles

Optimising string processing in Rust

How CockroachDB Wrote a Massive & Complex Go Application | Cockroach Labs

(2) Design decision: Tokio tasks vs. regular threading for stateful and CPU-bound calculations : rust

mmcloughlin/avo: Generate x86 Assembly with Go

Rust Performance Guide

Heap Optimizations for Go Systems | by Nishant Roy | The Startup | Medium

Optimizing Go programs by AVX2 using Auto-Vectorization in LLVM. | by Masashi SHIBATA | Medium

Sequential Versus Random Disk Access - YouTube

Compiler Explorer

[Seqlock

[c++

Systems Performance: Enterprise and the Cloud

go scheduler

perf sampling vs tracing

Off-CPU Flame Graphs

An In-Depth Look Into the Internal Workings of Redis | by Shubham Agrawal | Better Programming

[shell

database

Writing a SQL database from scratch in Go: 1. SELECT, INSERT, CREATE and a REPL | notes.eatonphil.com

Arrow Columnar Format — Apache Arrow v4.0.1

vectorengine/vectorsql: VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

MySQL What is DDL, DML and DCL?

SQL Operators

Volcano - An Extensible and Parallel Query Evaluation System

Blog Engineering | Cockroach Labs

CMU 15-445/645 Database Systems (Fall 2018) :: Joins

calcite/SqlToRelConverter.java at branch-1.24 · apache/calcite

Antlr Grammar List

CMU Database Systems - 26 Systems Potpourri [CockroachDB, Spanner, MongoDB] (Fall 2018) - YouTube

CMU 15-445/645 Database Systems (Fall 2018) :: Systems Potpourri

CMU Database Systems - 24 Distributed OLAP Systems (Fall 2017) - YouTube

WiredTiger Storage Engine — MongoDB Manual

p850-ahmad.pdf

parquet-format/BloomFilter.md at master · apache/parquet-format · GitHub

[05

CMU 15-445/645 Database Systems (Fall 2019) :: Query Execution II

p29-neumann-cidr20.pdf

Transaction Processing

Umbra: A Disk-Based System with In-Memory Performance (Thomas Neumann) - YouTube

Code Generation for Data Processing

Code Generation for Data Processing

[Home

p29-neumann-cidr20.pdf

database b+tree indexing

CMU 15-445/645 Database Systems (Fall 2020) :: Two-Phase Locking

CMU 15-445/645 Database Systems (Fall 2022) :: Database Recovery

Is It Time to Rewrite the Operating System in Rust? - YouTube

Joseph M. Hellerstein

2208.13068.pdf

Bringing WebAssembly to PostgreSQL using Extism

System Design Interview | Distributed Systems in One Lesson | Tim Berglund - YouTube

network

[curl

IP Address Lookup for 43.207.139.156 in Tokyo, Japan

curl latency testing

curl request hops

[traceroute(8)

[reading a traceroute](https://resrequest.helpspot.com/index.php?pg=kb.page&id=437#:~:text=A traceroute displays the path,show up in these times.))

Wireshark User’s Guide

C++ HFT on Crypto Exchanges with μs Latency! - Roq Trading Solutions

Multicasting in Rust

[sockets

os

BPF CO-RE reference guide

Kernel bypass

eBPF in CPU Scheduler

From Linux CFS Scheduler to Goroutine Scheduler: How CFS Algorithm Could Be Used in Goroutine… - YouTube

What is RCU? — “Read, Copy, Update” — The Linux Kernel documentation

The Difficulties of Tracking Running Processes on Linux :: Tech Notes by Natan Yellin

bcc/tools/wakeuptime.py at cab1f40a9b223d5ddc2236a25dce9b834a64390a · iovisor/bcc

bcc/tools/execsnoop.py at master · iovisor/bcc

bcc/libbpf-tools/wakeuptime.bpf.c at cab1f40a9b223d5ddc2236a25dce9b834a64390a · iovisor/bcc

[SOCKMAP

zoidbergwill/awesome-ebpf: A curated list of awesome projects related to eBPF.

Linux BPF Superpowers | PPT

XDP in practice: integrating XDP into our DDoS mitigation pipeline

xdp-ddos.pdf

kernel ipc guide

tools

spf13/cobra: A Commander for modern Go CLI interactions

Apache Arrow for Go : golang

Apache Arrow and Java: Lightning Speed Big Data Transfer

Apache Arrow Tutorial for Beginners - Tutorial And Example

rust

Don’t use boxed trait objects

impl Trait vs dyn Trait? - Rust Internals

Rust Language Cheat Sheet

Style Guidelines

mre/idiomatic-rust: 🦀 A peer-reviewed collection of articles/talks/repos which teach concise, idiomatic Rust.

Should I pass by immutable move or just by value : rust

Infallible in std::convert - Rust

rustfmt/Configurations.md at master · rust-lang/rustfmt

ferrous-systems/elements-of-rust: rust style and philosophy

Idiomatic Rust Global Variables in Rust - SitePoint

[Introduction

Style Guidelines

The Rust runtime - The Rust Reference

splashsurf — command-line utility in Rust // Lib.rs

Rust Serialization Benchmark

hft

(1) Types of Quantitative Trading | LinkedIn

Nimrod_High_Frequency_Trading.pdf

options futures and derivatives

11-physical.pdf

1.1 Reading: Terminology and Trading Floors (60:00) SECTION 1: INTRODUCTION TO MARKET MAKING | Akuna Capital University

How do I design high-frequency trading systems and its architecture. Part II | LinkedIn

How Hedge Funds increased profitability | LinkedIn

Activity | Ariel Silahian | LinkedIn

Market Maker Definition: What It Means and How They Make Money

[Alpha Generator: Meaning, International Investments, Examples](https://www.investopedia.com/terms/a/alpha_generator.asp#:~:text=An alpha generator is any,selected benchmark without additional risk.))

CppCon 2017: Carl Cook “When a Microsecond Is an Eternity: High Performance Trading Systems in C++” - YouTube

A Proposal to Add Hash Tables to the Standard Library

CppCon 2017: Carl Cook “When a Microsecond Is an Eternity: High Performance Trading Systems in C++” - YouTube

C++ Memory Model

Quantitative Trading Summary

The Making of an Ultra Low Latency Trading System with Go and Java

Rust HFT

Networking and high-frequency trading [LWN.net]

An Introduction to the Sequencer World - Electronic Trading Technology

[c++

How to Build a Fast Limit Order Book

Case Study: Algorithmic Trading With Go | Polygon

TA-MR Basic algotrading model | Grizzly Bulls

TA-Trend Basic algotrading model | Grizzly Bulls

Case study: Algorithmic trading with Go | Hacker News

0+: A Double Digit Sharpe HFT Strategy

(2) Where to put server for better connectivity : algotrading

Algo Strategies

rust-web-benchmarks/result/hello-world-AMD-EPYC-7B13.md at master · hyper-fast/rust-web-benchmarks

Building a Trading System – General Considerations « WK’s High Frequency Trading Blog

Delay in receiving first message from a websocket connection : highfreqtrading

Erik Rigtorp

exchange latency spreadsheet

How do I design high-frequency trading systems and its architecture. Part III

hft ui

roq-trading.com

Quantitative Trading Summary – Headlands Technologies LLC Blog

How I made $500k with machine learning and HFT…

key strategies - max dama