Sale!

Streaming Big Data with Spark Streaming and Scala – Hands On – Udemy

(10 customer reviews)

$17

Category:

Description

What you’ll learn

  • Process massive streams of real-time data using Spark Streaming
  • Integrate Spark Streaming with data sources, including Kafka, Flume, and Kinesis
  • Use Spark 2’s Structured Streaming API
  • Create Spark applications using the Scala programming language
  • Output transformed real-time data to Cassandra or file systems
  • Integrate Spark Streaming with Spark SQL to query streaming data in real time
  • Train machine learning models with streaming data, and use those models for real-time predictions
  • Ingest Apache access log data and transform streams of it
  • Receive real-time streams of Twitter feeds
  • Maintain stateful data across a continuous stream of input data
  • Query streaming data across sliding windows of time

Show moreShow less

New! Updated for Spark 3.0.0!

“Big Data” analysis is a hot and highly valuable skill. Thing is, “big data” never stops flowing! Spark Streaming is a new and quickly developing technology for processing massive data sets as they are created – why wait for some nightly analysis to run when you can constantly update your analysis in real time, all the time? Whether it’s clickstream data from a big website, sensor data from a massive “Internet of Things” deployment, financial data, or something else – Spark Streaming is a powerful technology for transforming and analyzing that data right when it is created, all the time.

You’ll be learning from an ex-engineer and senior manager from Amazon and IMDb.

This course gets your hands on to some real live Twitter data, simulated streams of Apache access logs, and even data used to train machine learning models! You’ll write and run real Spark Streaming jobs right at home on your own PC, and toward the end of the course, we’ll show you how to take those jobs to a real Hadoop cluster and run them in a production environment too.

Across over 30 lectures and almost 6 hours of video content, you’ll:

  • Get a crash course in the Scala programming language

  • Learn how Apache Spark operates on a cluster

  • Set up discretized streams with Spark Streaming and transform them as data is received

  • Use structured streaming to stream into dataframes in real-time

  • Analyze streaming data over sliding windows of time

  • Maintain stateful information across streams of data

  • Connect Spark Streaming with highly scalable sources of data, including Kafka, Flume, and Kinesis

  • Dump streams of data in real-time to NoSQL databases such as Cassandra

  • Run SQL queries on streamed data in real time

  • Train machine learning models in real time with streaming data, and use them to make predictions that keep getting better over time

  • Package, deploy, and run self-contained Spark Streaming code to a real Hadoop cluser using Amazon Elastic MapReduce.

This course is very hands-on, filled with achievable activities and exercises to reinforce your learning. By the end of this course, you’ll be confidently creating Spark Streaming scripts in Scala, and be prepared to tackle massive streams of data in a whole new way. You’ll be surprised at how easy Spark Streaming makes it!

Who this course is for:

  • Students with some prior programming or scripting ability SHOULD take this course.
  • If you’re working for a company with “big data” that is being generated continuously, or hope to work for one, this course is for you.
  • Students with no prior software engineering or programming experience should seek an introductory programming course first.

Course content

  • Getting Started
  • A Crash Course in Scala
  • Spark Streaming Concepts
  • Spark Streaming Examples with Twitter
  • Spark Streaming Examples with Clickstream / Apache Access Log Data
  • Integrating with Other Systems
  • Advanced Spark Streaming Examples
  • Spark Streaming in Production
  • You Made It!

10 reviews for Streaming Big Data with Spark Streaming and Scala – Hands On – Udemy

  1. Donny Phan

    Super practical. Lessons are catered towards anyone looking to find work in this industry. It felt very comprehensive and gave me a broad understanding of the programming spectrum

  2. Madhav raj Verma

    Thanks for your great effort. i am fully satisfied with this course the way you teach and your explanation are very clear ,The content you provide in your course no one can do this at this price.

  3. Sachin Gupta

    I really didn’t want to leave a low rating as Angela is a great teacher. The 1st half of this course was terrific. The 2nd half was terrible. Under the justification of “teaching students how to figure things out on their own”, pretty much all videos and all explanations were dropped. You were just told what to do, given links to documentation and told to figure it out on your own. I understand doing that to some degree, but to revert to that entirely for nearly half the content barely makes this a course. It’s just a list of things for you to learn, then you’re left on your own to learn them. The 2nd half was so bad, especially the data science component, that I didn’t bother finishing the course.

  4. Vincent Beaudet

    Amazing 40 days course.
    Angela is a great teacher.
    The other 60 days are all about web developement, interacting with web pages, on your own with little to no explanations. I did not expect that at all. I wanted to learn more about software and scripting.
    This left me disappointed , confused and i started to doubt myself. Not a fun experience after the amount of effort i’v put in this course.

    Exercices format and explanations for the first 40 days were worth it tho.

  5. Ben K

    Not just an introduction to python, but really helps you learn fundamental aspects of python and coding in general. Some parts may require some knowledge on the subject (data science comes to mind) and there is quite some web development in the course. So, a few areas were not completely to my liking (I would have liked to see it done differently), but this course deserves the 5 stars in my opinion.

  6. Omid Alikhel

    I found the method a bit difficult when a code is written and then changed back to something different, with no enough explanation of how something happened and where it came from or a step by step explanation of why something is happening, i have no doubt in the instructors talent, but we are beginners!

  7. Devang Jain

    The course is not updated and most of the solution codes don’t work and there are no video solutions towards the end

  8. Szymon Kozak

    I think that the course tutor is really good in giving right information to learn at the right time. Thanks to this fact, my understanding of coding in python after 29 days of learning is above my expectations.

  9. Begoña Ruiz Diaz

    Ha sido la mejor elección que podría haber hecho.

  10. Vaibhav Sachdeva

    I want to thank Angela for making such an amazing course. It really helped me explore more things with python.

Add a review

Your email address will not be published.