| Description |
1 online resource (1 streaming video file (2 hr., 26 min., 8 sec.)) |
| Summary |
"Apache Spark is an extremely powerful general purpose distributed system that also happens to be extremely difficult to debug. This video, designed for intermediate-level Spark developers and data scientists, looks at some of the most common (and baffling) ways Spark can explode (e.g., out of memory exceptions, unbalanced partitioning, strange serialization errors, debugging errors inside your own code, etc.) and then provides a set of remedies for keeping those blow-ups under control. You'll pick up techniques for improving your own logging (and reducing your dependence on Spark's verbose logs); learn how to deal with fuzzy data; discover how to connect and use a debugger in a distributed environment; and gain the ability to know which Spark error messages are actually relevant."--Resource description page |
| Notes |
Title from title screen (viewed January 30, 2019) |
| Performer |
Presenter, Holden Karau |
| SUBJECT |
Spark (Electronic resource : Apache Software Foundation) http://id.loc.gov/authorities/names/no2015027445
|
|
Spark (Electronic resource : Apache Software Foundation) fast (OCoLC)fst01938143 |
| Subject |
Debugging in computer science.
|
|
Computer programs -- Testing.
|
|
Computer programs -- Testing.
|
|
Debugging in computer science.
|
| Form |
Streaming video
|
|
