🏢
🌐 Entity
Distributed computing
System with multiple networked computers
📊 Rating
2 news mentions · 👍 0 likes · 👎 0 dislikes
📌 Topics
- Machine Learning (1)
- Data Distribution (1)
- Distributed Computing (1)
- AI Training Optimization (1)
- System Architecture (1)
🏷️ Keywords
Federated Learning (1) · Active Learning (1) · Non-IID Data (1) · Class Imbalance (1) · Distributed Systems (1) · Model Efficiency (1) · Data Sampling (1) · FSDP (1) · ZeRO (1) · veScale-FSDP (1) · RaggedShard (1) · Large-scale AI training (1) · Distributed computing (1) · GPU scaling (1) · Model parallelism (1)
📖 Key Information
Distributed computing is a field of computer science that studies distributed systems, defined as computer systems whose inter-communicating components are located on different networked computers.
The components of a distributed system communicate and coordinate their actions by passing messages to one another in order to achieve a common goal. Three challenges of distributed systems are: maintaining concurrency of components, overcoming the lack of a global clock, and managing the independent failure of components.
📰 Related News (2)
-
🇺🇸 Federated Active Learning Under Extreme Non-IID and Global Class Imbalance
arXiv:2603.10341v1 Announce Type: cross Abstract: Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its ...
-
🇺🇸 veScale-FSDP: Flexible and High-Performance FSDP at Scale
arXiv:2602.22437v1 Announce Type: cross Abstract: Fully Sharded Data Parallel (FSDP), also known as ZeRO, is widely used for training large-scale mod...