Jump to content

Scheduling multiple notebooks to execute in a sequence using spy.job.schedules


SBC

Recommended Posts

I have two notebooks that have to have to be run at a cadence of every 6 months - the first notebook's output (image files) is used by the second notebook (to push the image files to an organizer topic).

I scheduled two jobs with separate spy.jobs.schedule function calls using the url of the corresponding notebook, staggering the schedule time to be an hour apart. Attached below are some code snippets showing the two cells of code that scheduled the jobs separately.

However, when the scheduled time was reached, Datalab executed the second notebook only (the Job_Results folder contained the execution snapshot of the second notebook corresponding to Job2_notebook_url only).

Is this a limitation of the current Datalab architecture i.e. only a single notebook can be scheduled to run for one datalab project ?

 

image.png.c3b73391b8d131f51971e4374f6c69ba.png

 

image.png.03e78fd90f832c404cc2e71d26e2a207.png

Link to comment
Share on other sites

  • Members

Data Lab allows for multiple jobs to be scheduled in the same project. Each job should create a separate executor.0.html file in the _Job Results folder after the job has run. Are you sure that your first job was scheduled correctly? The attached screenshots don't show the full schedule confirmation & detail so it is hard for me to tell.

If you are still having issues, feel free to create a support ticket at https://support.seeq.com/ so we can troubleshoot further!

  • Thanks 1
Link to comment
Share on other sites

Thanks Mark for confirming that it is not a limitation to have multiple jobs - I will double check and make sure there is no other issues with the notebook/schedule command stoping it from executing.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...