PerfUG: Working with the Type Safe Scalding API

  Performance User Group

Date: jeudi 17 mars 2016 à 19:00
Catégorie: Technologie
Ville: Paris , Paris Ile-de-France

Scalding is a go-to choice for developing MapReduce jobs and the new(ish) Type Safe API promises to make jobs ever more safer, without adding any additional testing overhead (and, of course, you all test your jobs). Even nicer, it promises to add performance optimizations for free! Actually, it's not that easy and one has to analyze what's under the hood.

In the process of rolling out the Type Safe API of Scalding at Criteo we encountered a number of pitfalls made more difficult to overcome by the lack of documentation and examples. During this talk we'll present a down and dirty look at how we can optimize any job from the source code and the generated counters.

Those tips and tricks will be useful for any Hadoop development, actionable straight after the talk!

Sofian Djamaa is a passionate programmer fond of solving head-scratching problems in challenging environments such as big data architectures, low latency systems and complex algorithmic situations (machine learning, optimizations). At Criteo, Sofian is the chief sponsor of Scalding, Summingbird and other data processing frameworks.

50 avenue des Champs-Élysées 5e étage

[ Signaler un changement ]

Les informations ci-dessus, sont dans la mesure du possible, correctes, mais sont données à titre purement indicatif et n'engagent pas l'équipe Agendao. Il est vivement conseillé de vérifier sur le site de l'événement.