你好! Shipping to Taiwan with premium packaging for just NT$300 

Ship to
Taiwan
0

My Account

  • argentina
  • chile
  • colombia
  • españa
  • méxico
  • perú
  • estados unidos
  • internacional

menu

Select your country

Americas

Europe

Rest of the world

portada Parallel Computing Cluster for Solving Computational Problems in Data
Type
Physical Book
Publisher
Author
Language
English
Pages
56
Format
Paperback
Dimensions
22.9x15.2x0.3 cm
ISBN13
9786209340734

Parallel Computing Cluster for Solving Computational Problems in Data

Mutyala Rao, Chavala (Author) · LAP Lambert Academic Publishing · Paperback

Parallel Computing Cluster for Solving Computational Problems in Data - Mutyala Rao, Chavala

Cheaper New Book Imported to Taiwan
Delivery: 13 Nov - 23 Nov Shipping: 13 to 14 business days.
NT$ 1,654
Faster New Book Imported to Taiwan
Delivery: 03 Nov - 11 Nov Shipping: 5 to 6 business days.
NT$ 1,786
NT$ 1,654

Choose the list to add your product or create one New List

Go to My Wishlists
Calculate shipping cost

Synopsis "Parallel Computing Cluster for Solving Computational Problems in Data"

Thisbook tackles a critical bottleneck in large-scale AI: the slow and communication-heavy training of massive Deep Neural Networks (DNNs) on multi-GPU systems. It addresses the trade-off between two main parallelization methods. Data parallelism suffers from severe communication overhead for large models, while pipelined model parallelism (like PipeDream) offers up to 8.91x speedup for large Fully Connected/Recurrent Neural Networks but causes "weight staleness," degrading model accuracy. To resolve this, the paper introduces SpecTrain, a novel technique. SpecTrain uses the momentum from optimizers to predict future weight updates, allowing pipelined computation with accurate, non-stale weights. This enables the high GPU utilization and speed of pipelining while maintaining the training robustness and final accuracy of synchronous methods.

Customers reviews

More customer reviews
  • 0% (0)
  • 0% (0)
  • 0% (0)
  • 0% (0)
  • 0% (0)

Frequently Asked Questions about the Book

Is the book original?

All books in our catalog are Original.

In what language is the book written?

The book is written in English.

What is the format of this book?

The binding of this edition is Paperback.

Questions and Answers about the Book

Do you have a question about the book? Login to be able to add your own question.

Opinions about Bookdelivery

More customer reviews