pipeDejavu: Hardware-aware Latency Predictable, Differentiable Search for Faster Config and Convergence of Distributed ML Pipeline Parallelism
python
deep-learning
linear-regression
pytorch
dynamic-programming
predictive-modeling
data-parallelism
sampling-methods
model-parallelism
distributed-training
differentiable-programming
pipeline-parallelism
hardware-aware
parallel-optmization
random-initialization
baysian-optimisation
differentiable-dynamic-programming
-
Updated
May 9, 2023 - Jupyter Notebook