MapReduce Application Master API’s.

class yarn_api_client.application_master.ApplicationMaster(address=None, port=8088, timeout=30)

The MapReduce Application Master REST API’s allow the user to get status on the running MapReduce application master. Currently this is the equivalent to a running MapReduce job. The information includes the jobs the app master is running and all the job particulars like tasks, counters, configuration, attempts, etc.

If address argument is None client will try to extract address and port from Hadoop configuration files.

Parameters:
  • address (str) – Proxy HTTP address
  • port (int) – Proxy HTTP port
  • timeout (int) – API connection timeout in seconds
application_information(application_id)

The MapReduce application master information resource provides overall information about that mapreduce application master. This includes application id, time it was started, user, name, etc.

Returns:API response object with JSON data
Return type:yarn_api_client.base.Response
job(application_id, job_id)

A job resource contains information about a particular job that was started by this application master. Certain fields are only accessible if user has permissions - depends on acl settings.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
job_attempts(job_id)

With the job attempts API, you can obtain a collection of resources that represent the job attempts.

Parameters:job_id (str) – The job id
Returns:API response object with JSON data
Return type:yarn_api_client.base.Response
job_conf(application_id, job_id)

A job configuration resource contains information about the job configuration for this job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
job_counters(application_id, job_id)

With the job counters API, you can object a collection of resources that represent all the counters for that job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
job_task(application_id, job_id, task_id)

A Task resource contains information about a particular task within a job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
  • task_id (str) – The task id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
job_tasks(application_id, job_id)

With the tasks API, you can obtain a collection of resources that represent all the tasks for a job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
jobs(application_id)

The jobs resource provides a list of the jobs running on this application master.

Parameters:application_id (str) – The application id
Returns:API response object with JSON data
Return type:yarn_api_client.base.Response
task_attempt(application_id, job_id, task_id, attempt_id)

A Task Attempt resource contains information about a particular task attempt within a job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
  • task_id (str) – The task id
  • attempt_id (str) – The attempt id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
task_attempt_counters(application_id, job_id, task_id, attempt_id)

With the task attempt counters API, you can object a collection of resources that represent al the counters for that task attempt.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
  • task_id (str) – The task id
  • attempt_id (str) – The attempt id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
task_attempts(application_id, job_id, task_id)

With the task attempts API, you can obtain a collection of resources that represent a task attempt within a job.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
  • task_id (str) – The task id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response
task_counters(application_id, job_id, task_id)

With the task counters API, you can object a collection of resources that represent all the counters for that task.

Parameters:
  • application_id (str) – The application id
  • job_id (str) – The job id
  • task_id (str) – The task id
Returns:

API response object with JSON data
Return type:

yarn_api_client.base.Response