Simple and effective Workarounds !

Tuesday, 2 February 2016

Monitor Spark Processes (List spark processes running)

If you are running spark process over yarn cluster then there  is a way to list the spark processes running

yarn application -list

Spark Streaming Process

To kill a running process :

 yarn application -kill application_id


Posted by Unknown at 23:44
Email ThisBlogThis!Share to XShare to FacebookShare to Pinterest
Labels: Kill spark process, Spark Streaming, Yarn

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

Total Pageviews

Contributors

  • Lokesh Nanda
  • Unknown

Blog Archive

  • ►  2020 (1)
    • ►  July (1)
  • ►  2019 (1)
    • ►  December (1)
  • ►  2018 (4)
    • ►  August (2)
    • ►  May (1)
    • ►  March (1)
  • ►  2017 (3)
    • ►  September (2)
    • ►  May (1)
  • ▼  2016 (34)
    • ►  December (1)
    • ►  October (1)
    • ►  September (1)
    • ►  August (3)
    • ►  July (3)
    • ►  June (10)
    • ►  March (2)
    • ▼  February (8)
      • Create Identity column in Hive for dump in Hbase
      • Script for getting count and name of table from Hi...
      • Connect Linux HDInsight cluster with PowerBi/Tableau
      • Shell Script for automating GA
      • Monitor Spark Processes (List spark processes runn...
      • Copy Startup Files from Azure Blob to Local everyt...
      • How to pass Parameter in HIVE hql
      • Catch Logs In Sqoop
    • ►  January (5)
  • ►  2015 (29)
    • ►  December (8)
    • ►  November (1)
    • ►  October (4)
    • ►  September (6)
    • ►  August (10)
Simple theme. Theme images by luoman. Powered by Blogger.