View AI Services Activity

The AI Services Activity Log provides critical insight into:

  • Job traffic and activity.

  • All tasks run for a job.

  • The completion status of all Sensible Machine Learning jobs.

  • Why a job may not have completed successfully.

You can review this information at any time in the project creation process or during model build or utilization phases.

Access the Activity Logs

To open the AI Services Log, click at the top of any Sensible Machine Learning page. This button is also available on the Sensible Machine Learning Home page.

The log displays the job activity and error log for Sensible Machine Learning. You can order, sort, and filter records for both views. To filter the logs, select a search type from the drop-down menu. After selecting a search type, a Search Method and Filter Value display for both jobs and tasks. Edit the Search method if needed and input a filter value. Click Filter once these settings have been selected. Select a job and click Progress to see the selected job's progress in the Job Progress dialog box, which shows the job's current activity status.

Monitor Job Activity

Sensible Machine Learning tracks all jobs and each job's tasks. Use the Job Activity Table in the AI Services Activity log to see general job traffic and job details, completion status, queue order of jobs set to run immediately or on a schedule, and other job and task details.

The Job Activity page has a Job Activity Table pane and a Tasks pane. Both panes list activity in the OneStream grid, so items in the grid can be ordered, sorted by any column, and filtered. All items in a grid can be sorted using the sort functionality.

TIP: Use the scroll bars in either pane to see all columns.

Each item in the Job Activity Table represents a job that has run in Sensible Machine Learning. Select a job to see the job's tasks in the Tasks pane. Each job includes the following:

Job Activity ID: Unique GUID given to the job when first queued.

Activity Type: Part of the project or page in Sensible Machine Learning where the job was generated.

Activity Status: The current status of the job.

  • queued: Indicates if the job or task is queued to run. If a job is scheduled, it is queued with a QueuedTime when the job is scheduled to run.

  • running: The job or task is currently running.

  • running_subtasks: An orchestrator task is currently running subtasks.

  • completed: The job or task completed successfully.

  • syserror/syscancelled:The job or task failed due to a system failure or the system canceling the job or task.

  • usercancelled: The job or task was cancelled by a user.

  • syserror_re-runnable: The job or task failed due to a data validation error and can be re-run once the issue has been resolved.

  • worker_queued: The task is currently in the queue to be picked up by a worker. This is only an activity status for atomic tasks and not jobs.

Percent Complete: Completion percentage of all the job's tasks.

Creation Time, Queued Time: Time that the job was created and moved to the job execution queue.

Start Time, End Time: Job's start and end dates and times.

Last Activity Time: Time that the most recent job activity completed. When a job successfully completes, this is the same as the End Time.

Is Scheduled: Selected indicates that the job was originally scheduled or scheduled to run at a future date and time.

Project Name: Name given to the project when it was created. <No Project> displays if the job did not execute for a specific Sensible Machine Learning project. <Deleted Project> displays if the job run for a specific Sensible Machine Learning project has been deleted.

App Name: Application responsible for running the job.

Total Tasks, Completed Tasks: Number of tasks run by the job and the number of tasks that ran successfully.

Server Name: The name of the server where the job completed.

Project ID: GUID given to the Sensible Machine Learning project when it was created.

Information displayed for tasks include:

Task Activity ID: Unique identifier assigned to the task when it is created.

Activity Status: The current status of the job.

  • queued: Indicates if the job or task is queued to run. If a job is scheduled, it is queued with a QueuedTime when the job is scheduled to run.

  • running: The job or task is currently running.

  • running_subtasks: An orchestrator task is currently running subtasks.

  • completed: The job or task completed successfully.

  • syserror/syscancelled:The job or task failed due to a system failure or the system canceling the job or task.

  • syserror_re-runnable: The job or task failed due to a data validation error and can be re-run once the issue is resolved.

  • data_validation_error: The job or task failed due to a data validation error.

  • worker_queued: The task is currently in the queue to be picked up by a worker. This is only an activity status for atomic tasks and not jobs.

Percent Complete: Completion percentage of all the job's tasks.

Queued Time, Start Time, End Time, Last Activity Time, Percent Complete: These columns have the same type of information as they do for jobs, but these are for a selected job's tasks.

Task Execution Type: Indicates whether the task is synthetic, atomic, sequential, or parallel.

Task Level, Task Order: Order of a job within the displayed task level.

Task Path: The routine within the job where the task runs.

  • Synthetic: A task that runs within an atomic task. It is only included in the AI Services Task Activity log if the task fails.

  • Atomic: One which has a simple, self-contained definition (for example, one that is not described in terms of other workflow tasks) and only one instance of the task runs when it is initiated.

  • Sequential: Tasks are distributed across different processors and run in a specific order.

  • Parallel: Task is distributed with other tasks across different processors and concurrently run by processes.

Detail Name:

Retries

Removed From Tree:

Process ID: Unique identifier assigned to the process in which the job was run.

Server Name: The name of the server that completed the job.

Parent Task Activity ID: Unique identifier assigned to the task's parent when it is created.

Job Activity ID: Unique identifier assigned to the task's job when it is created.

Review Job Errors

Use the Error Log for information on why a job did not run properly or run to completion, and to aid in error diagnosis and resolution. Types of errors include job execution errors for a specific project, Sensible Machine Learning updates, and login and other connection failures.

The Error log provides error details for each failed job and task.

Each entry includes the following information:

Message: Message associated with the error.

Captured Time: The time that the error occurred.

Log Level: Categorizes the severity of the error. Though warnings are logged, they do not necessarily stop a job from running.

Log Source: XperiFlow module where the error occurred.

Project Name: The name of the project that caused the error. <No Project> displays if the error did not occur for a specific Sensible Machine Learning project.

Error Category: General type of error that occurred. NA displays for errors not associated with a specific category.

Error Info: Similar to the information in the Message column, this is detailed information about what occurred to cause the error. For SQL statements that cause an error, this can include details about where in the statement the failure occurred. This information can help technical support with error diagnosis and resolution.

Server Name: The name of the server where the error occurred. Useful when a job is parallelized with multiple servers.

Process Name, Process ID: Unique identifiers that point to the specific process within a server where the error occurred.

Thread Name, Thread ID: Unique identifiers that point to the thread in which the error occurred.

Project ID: Unique identifier given to the project when the project was created. Zeros in this column indicate the error is not associated with a specific project.

Job Activity ID, Task Activity ID: Unique identifiers for the job and task within the job that encountered the error. Zeros in this column indicate the error was not associated with a specific Sensible Machine Learning task or job.

Log Level Number: The number assigned to the type of error. For example, a warning is level 30, an error is level 40.

JSON:

NOTE: Jobs that are not associated with a specific project show zeros for the Job ID, Task ID, and Project ID.

Find Specific Jobs, Tasks, or Errors

The AI Services Log also lets you search for specific jobs, tasks within jobs, and errors. This is useful when you what to find a specific item or items (jobs, tasks, or errors) within a large number of items, or your Job Activity or Error log has multiple pages. Use the search along with table sorting to speed your search of items in the AI Services Activity Log.

Select a search type, then type an ID for the item you want to search for and click Filter. In the Job Activity, you can find Jobs by the Job Activity ID or Project ID to find all jobs in a project. Search by Task Activity ID to find specific tasks.

The Error log lets you find specific errors by Job Activity ID or Task Activity ID, or Project ID. The ID you enter must match the ID exactly, though lowercase letters in the search will match. The following graphic shows the search in the Error Log.

Search for errors in the Error log by entering the Job Activity ID.