Skip to content

Nutter sometimes report a client error 400, but the test notebook is still running #48

@tomconte

Description

@tomconte

nutter sometimes fails with the following error while waiting for a test notebook to run:

--> Execution request: /Shared/Temp-CI/testing/test_MAIN
CRITICAL:NutterCLI:400 Client Error: Bad Request for url: https://adb-6447267702748866.6.azuredatabricks.net/api/2.0/jobs/runs/get-output?run_id=3052
 Response from server: 
 { 'error_code': 'INVALID_STATE',
  'message': 'Run result is empty. There may have been issues while saving or '
             'reading results.'}

However when I look at the state of the run mentioned in the error, it is in fact still running:

databricks runs get-output --run-id 3052
{
  "metadata": {
    "job_id": 3052,
    "run_id": 3052,
    "number_in_job": 1,
    "state": {
      "life_cycle_state": "RUNNING",
      "state_message": "In run"
    },
    "task": {
      "notebook_task": {
        "notebook_path": "/Shared/Temp-CI/testing/test_MAIN"
      }
    },
    "cluster_spec": {
      "existing_cluster_id": "0915-120444-foe167"
    },
    "cluster_instance": {
      "cluster_id": "0915-120444-foe167",
      "spark_context_id": "8879206558517982464"
    },
    "start_time": 1603279418051,
    "setup_duration": 3000,
    "execution_duration": 0,
    "cleanup_duration": 0,
    "creator_user_name": "[email protected]",
    "run_name": "dd2007c3-138f-11eb-a099-000d3adb5ca4",
    "run_page_url": "https://northeurope.azuredatabricks.net/?o=6447267702748866#job/3052/run/1",
    "run_type": "SUBMIT_RUN"
  },
  "notebook_output": {}
}

This does not happen consistently.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions