Batch Vs Stream Processing

Batch Processing

Intro

  • Ad-Hoc or Scheduled processing

  • Data Needs To Be Collected Before Hand Before Processing

  • Have Prior Knowledge About The Compute / Storage Resources

  • Batch processing is lengthy and is meant for large quantities of information that aren’t time-sensitive

  • Can Be Used On Compute Intensive Tasks

  • The Primary Performance Measure of a batch job is usually throughput

  • Due To Large Volume Of Data It Usually Requires A Distributed Storage like HDFS

  • Tools : Hadoop MR , Spark

Stream Processing

PreviousChange Data Capture @ MySQLNextBook Summaries

Last updated