分散式系統論文筆記目錄

理論

一致性模型

  1. Consistency in Non-Transactional Distributed Storage Systems

  1. Closing The Performance Gap between Causal Consistency and Eventual Consistency
  2. Weak Consistency: A Generalized Theory and Optimistic Implementations for Distributed Transactions
  3. Limitations of Highly-Available Eventually-Consistent Data Stores 筆記
  4. Linearizability: A Correctness Condition for Concurrent Objects

隔離性模型

  1. Highly Available Transactions: Virtues and Limitations

分散式時鐘

  1. Time, clocks, and the ordering of events in a distributed system 筆記
  2. Interval Tree Clocks
  3. Plausible clocks: Constant size logical clocks for distributed systems
  4. A Comparison Between Lamports Scalar Clocks and Singhal & Kshemkalyanis Vector Clocks

演算法

共識演算法

  1. Paxos Made Simple 筆記
  2. Revisiting the paxos algorithm
  3. Lower bounds for asynchronous consensus
  4. Fast Paxos
  5. Generalized Consensus and Paxos
  6. There Is More Consensus in Egalitarian Parliaments

以上是關於 Paxos 演算法的論文,此處應有個小結

  1. In Search of an Understandable Consensus Algorithm 筆記(含與 Paxos 的簡單對比)
  2. Planning for change in a formal verification of the raft consensus protocol
  3. Consensus: Bridging Theory And Practice

以上是關於 Raft 演算法的論文,此處應有個小結

  1. Impossibility of distributed consensus with one faulty process
  2. Brief Announcement: A Tight Space Bound for Consensus
  3. GentleRain : Cheap and Scalable Causal Consistency with Physical Clocks
  4. A comprehensive study of Convergent and Commutative Replicated Data Types 筆記

Erasure Coding

  1. Erasure Coding in Windows Azure Storage

分散式系統中間件

網路坐標系統

  1. Vivaldi: A Decentralized Network Coordinate System
  2. Network coordinates in the wild

失效檢測器

  1. The φ accrual failure detector 筆記
  2. Failure Detection in Large-Scale Systems: a Survey

成員管理

  1. SWIM: Scalable Weakly-consistent Infection-style process group Membership protocol 筆記
  2. Lifeguard : SWIM-ing with Situational Awareness
  3. Correctness of a gossip based membership protocol
  4. HyParView: A Membership Protocol for Reliable Gossip-Based Broadcast

分散式共享內存

  1. Sinfonia: a new paradigm for building scalable distributed systems 筆記

重疊網路

網路結構

  1. A survey of peer-to-peer content distribution technologies
  2. Peer to Peer Networks Management Survey
  3. The essence of P2P: A reference architecture for overlay networks

張帥:論文筆記:關於 P2P 的一些綜述?

zhuanlan.zhihu.com圖標

  1. Chord: A scalable content-addressable network
  2. A Scalable Content-Addressable Network
  3. Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
  4. Tapestry: A global-scale overlay for rapid service deployment
  5. Kademlia: A Peer-to-Peer Information System Based on the XOR Metric
  6. DKS(N, k, f): a family of low communication, scalable and fault-tolerant infrastructures for P2P applications

此處應有一份關於以上論文的總結

  1. Skip graphs

網路通信

  1. Randomized rumor spreading
  2. Randomized rumor spreading revisited
  3. Brief Announcement: Optimal Address-Oblivious Epidemic Dissemination

張帥:論文筆記:[FOCS 2000] Randomized rumor spreading?

zhuanlan.zhihu.com圖標

  1. Scribe: A large-scale and decentralized application-level multicast infrastructure
  2. Application-Level Multicast using Content-Addressable Networks
  3. Ccag: Gossip Based Reliable Multicast Protocol
  4. Efficient and adaptive epidemic-style protocols for reliable and scalable multicast

分散式存儲

Key-Value 存儲

  1. Dynamo: Amazon』s Highly Available Key-value Store 筆記
  2. SILT: A Memory-Efficient, High-Performance Key-Value Store
  3. Efficient and Available In-memory KV-Store with Hybrid Erasure Coding and Replication
  4. Ambry: LinkedIns Scalable Geo-Distributed Object Store
  5. The RAMCloud Storage System
  6. Finding a needle in Haystack: facebooks photo storage 筆記
  7. F4: Facebooks Warm BLOB Storage System 筆記
  8. Windows Azure Storage : A Highly Available Cloud Storage Service with Strong Consistency

文件存儲

  1. The Google file system
  2. GFS: Evolution on Fast-Forward
  3. Colossus: Successor to the Google File System (GFS)

此處應有一份關於以上論文的總結

  1. The Hadoop Distributed File System
  2. Ceph: a scalable, high-performance distributed file system
  3. The quantcast file system

分散式資料庫

  1. Spanner: Googles Globally-Distributed Database
  2. Megastore: Providing Scalable, Highly Available Storage for Interactive Services
  3. F1: A Distributed SQL Database That Scales
  4. H-store: A High-Performance, Distributed Main Memory Transaction Processing System

時間序列資料庫

  1. Gorilla: A Fast, Scalable, In-Memory Time Series Database
  2. LittleTable: A Time-Series Database and Its Uses

列式存儲

結構化存儲

  1. Bigtable: A Distributed Storage System for Structured Data
  2. Cassandra: a decentralized structured storage system

分散式索引

  1. SLIK: scalable low-latency indexes for a key-value store

分散式計算

離線計算

MapReduce, Spark, etc.

在線計算

Streaming, OLAP, etc.

增量計算

  1. Large-scale Incremental Processing Using Distributed Transactions and Notifications

分散式緩存

memcached, tachyon, etc.


分散式資源管理

  1. Resource Management in Clouds: Survey and Research Challenges
  2. Apache Hadoop YARN: yet another resource negotiator
  3. Mesos: a platform for fine-grained resource sharing in the data center
  4. Omega: flexible, scalable schedulers for large compute clusters
  5. Large-scale cluster management at Google with Borg
  6. Firmament: Fast, Centralized Cluster Scheduling at Scale
  7. Apollo: Scalable and Coordinated Scheduling for Cloud-Scale Computing

分散式事務

  1. Consensus on Transaction Commit
  2. Omid , Reloaded : Scalable and Highly-Available Transaction Processing

推薦閱讀:

分散式系統測試的應用方法——場景注入測試
閱讀筆記:PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs
Elasticsearch分散式一致性原理剖析(一)-節點篇
yaraft 的開發近況〔2017.11〕

TAG:論文 | 分散式系統 |