Knowledge Base
main
main
  • Hello , There !!!
  • Blogs , Thoughts , Etc
    • Blogs
      • What happens when you type a URL into your browser?
      • HTTP Keep Alive Vs TCP keep Alive
      • How Browsers Work ?
      • Change Data Capture @ MySQL
    • Batch Vs Stream Processing
    • Book Summaries
      • 12 Rules for Life
    • Random Thoughts
      • Being On The Right Side Of The “Zero”
      • I ̶F̶̶a̶̶i̶̶l̶̶e̶̶d̶ Learnt Something New.
  • NODE JS
    • Parsing HTML DOM
    • Make HTTP Request
    • Read SQLite File
    • Remove Directory Recursively
  • JavaScript
    • Event Loop In JavaScript
  • Numbers
    • Untitled
  • Random
    • Google File System
    • Concurrency vs Parallelism
    • Spark
    • Apache Kafka[WIP]
  • Python
    • Python Memory Model
    • Multithreading With LightWeight Threads
    • Logger
  • JAVA
    • Java Memory Model
  • SQL
    • Untitled
    • Page 1
  • Machine Learning
    • Page 2
  • Productivity
    • Git
    • ssh
  • Hacks
    • Good Youtube Channels
Powered by GitBook
On this page
  • Batch Processing
  • Intro
  • Stream Processing

Was this helpful?

  1. Blogs , Thoughts , Etc

Batch Vs Stream Processing

Batch Processing

Intro

  • Ad-Hoc or Scheduled processing

  • Data Needs To Be Collected Before Hand Before Processing

  • Have Prior Knowledge About The Compute / Storage Resources

  • Batch processing is lengthy and is meant for large quantities of information that aren’t time-sensitive

  • Can Be Used On Compute Intensive Tasks

  • The Primary Performance Measure of a batch job is usually throughput

  • Due To Large Volume Of Data It Usually Requires A Distributed Storage like HDFS

  • Tools : Hadoop MR , Spark

Stream Processing

PreviousChange Data Capture @ MySQLNextBook Summaries

Last updated 3 years ago

Was this helpful?