Taskomatic reports java.lang.IllegalStateException and javax.persistence.EntityNotFoundException.

This document (7022958) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Manager 3.1

Situation

SUSE Manager job schedules such as ssh-push-default, errata-queue-default or cobbler-sync-default report java.lang.IllegalStateException in /var/log/rhn/rhn_taskomatic_daemon.log like:

INFO   | jvm 1    | 2018/05/13 21:57:00 | 2018-05-13 21:57:00,062 [DefaultQuartzScheduler_Worker-7] ERROR org.quartz.core.JobRunShell - Job DEFAULT.cobbler-sync-default threw an unhandled Exception:
INFO   | jvm 1    | 2018/05/13 21:57:00 | java.lang.IllegalStateException: Transaction not successfully started
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.hibernate.engine.transaction.internal.TransactionImpl.commit(TransactionImpl.java:63)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.common.hibernate.ConnectionManager.commitTransaction(ConnectionManager.java:255)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.common.hibernate.HibernateFactory.commitTransaction(HibernateFactory.java:331)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
INFO   | jvm 1    | 2018/05/13 21:57:00 | 2018-05-13 21:57:00,062 [DefaultQuartzScheduler_Worker-7] ERROR org.quartz.core.ErrorLogger - Job (DEFAULT.cobbler-sync-default threw an exception.
INFO   | jvm 1    | 2018/05/13 21:57:00 | org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.IllegalStateException: Transaction not successfully started]
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.quartz.core.JobRunShell.run(JobRunShell.java:227)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
INFO   | jvm 1    | 2018/05/13 21:57:00 | Caused by: java.lang.IllegalStateException: Transaction not successfully started
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.hibernate.engine.transaction.internal.TransactionImpl.commit(TransactionImpl.java:63)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.common.hibernate.ConnectionManager.commitTransaction(ConnectionManager.java:255)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.common.hibernate.HibernateFactory.commitTransaction(HibernateFactory.java:331)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
INFO   | jvm 1    | 2018/05/13 21:57:00 |       ... 1 more

In addition, an error message similar to the following is seen as well :

INFO | jvm 1 | 2018/05/14 00:00:27 | 2018-05-14 00:00:27,303 [DefaultQuartzScheduler_Worker-4] ERROR com.redhat.rhn.taskomatic.task.TokenCleanup - Executing a task threw an exception: javax.persistence.EntityNotFoundException
INFO | jvm 1 | 2018/05/14 00:00:27 | 2018-05-14 00:00:27,303 [DefaultQuartzScheduler_Worker-4] ERROR com.redhat.rhn.taskomatic.task.TokenCleanup - Stack trace:javax.persistence.EntityNotFoundException: deleted object would be re-saved by cascade (remove deleted object from associations): [com.redhat.rhn.domain.channel.Channel#1115]

Both conditions lead to jobs getting stuck in SUSE Manager.

Resolution

A Program Temporary Fix has been made available to address this issue. Please access the updates here:

https://ptf.suse.com/f2cf38b50ed714a8409693060195b235/susemanager-3.1/15348/x86_64/20180515

See TID 7016644 - Best practice for applying Program Temporary Fixes (PTFs) for help on updating the affected RPMs.

Cause

A problem with the access token handling and the database mappings for handling the cleanup jobs.

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.