Monday, August 24, 2015

IBM BPM PO types table (BPM DB Part)

IBM BPM 8.5.5 PO types table (BPM DB Part)


 PO_TYPE   Name                        BPMDB table  

 1      TWProcess (Service)           LSW_PROCESS
 2      IC (IntegrationComponent)     LSW_IC
 3      Connector                     LSW_CONNECTOR
 4      UCA (UnderCoverAgent)         LSW_UCA
 7      WebService                    LSW_WEB_SERVICE
 8      WebScript
 11     Report                        LSW_REPORT
 12     TWClass (VariableType)        LSW_CLASS
 13     Scoreboard                    LSW_SCBD
 14     TrackingGroup                 LSW_TRACKING_GROUP
 15     TimingInterval                LSW_TIMING_INTERVAL
 16     TrackingPoint                 LSW_TRACKING_POINT
 17     TrackedVariable               LSW_TRACKED_VARIABLE
 20     Layout                        LSW_LAYOUT
 21     EPV                           LSW_EPV
 22     GlobalVariable                deprecated
 24     Participant                   LSW_PARTICIPANT
 25     BPD                           LSW_BPD
 30     Priority                      LSW_PRIORITY
 31     Calendar                      deprecated
 40     CustomStatus                  deprecated
 42     AlertSeverity                 deprecated
 43     InfoPathForm                  LSW_INFOPATH_FORM
 47     SLA                           LSW_SLA
 49     Metric                        LSW_METRIC
 50     ResourceBundleGroup           LSW_RESOURCE_BUNDLE_GROUP
 51     UserAttributeDefinition       LSW_USER_ATTRIBUTE_DEF
 52     SimulationScenario            LSW_SIM_SCENARIO
 53     HistoricalScenario            LSW_HIST_SCENARIO
 54     OrgChart                      deprecated
 60     ExternalActivity              LSW_EXTERNAL_ACTIVITY
 61     ManagedAsset                  LSW_MANAGED_ASSET
 62     EnvironmentVariableSet        LSW_ENV_VAR_SET
 63     ProjectDefaults               LSW_PROJECT_DEFAULTS
 64     CoachView                     BPM_COACH_VIEW
 65     CoachViewBindingType          BPM_COACH_VIEW_BINDING_TYPE
 66     CoachViewConfigOption         BPM_COACH_VIEW_CONFIG_OPTION
 67     CoachViewResource             BPM_COACH_VIEW_RESOURCE
 68     CoachViewInlineScript         BPM_COACH_VIEW_INLINE_SCRIPT
 69     CoachViewLocalization         BPM_COACH_VIEW_LOCAL_RES
 70     CoachViewAMDDependency        BPM_COACH_VIEW_AMD_DEP
 71     EventSubscription             BPM_EVENT_SUBSCRIPTION
 1989   ExtendedPropertySet           LSW_EXTENDED_PROPERTY_SET
 2000   ExtendedProperty              LSW_EXTENDED_PROPERTY
 2001   AlertType                     deprecated
 2002   SapConnection                 LSW_SAP_CONNECTION
 2005   Breakpoint                    LSW_BREAKPOINT
 2006   BpdEvent                      LSW_BPD_EVENT
 2007   BpdParameter                  LSW_BPD_PARAMETER
 2008   BpmEvent                      BPM_BPD_EVENT
 2013   EpvVar                        LSW_EPV_VAR
 2014   EpvVarValue                   LSW_EPV_VAR_VALUE
 2015   Favorite                      LSW_FAVORITE
 2018   ICInputProperty               LSW_IC_INPUT_PROPERTY
 2019   ICOutputProperty              LSW_IC_OUTPUT_PROPERTY
 2020   TimingIntervalBound           LSW_TIMING_INTERVAL_BOUND
 2022   Launcher                      LSW_LAUNCHER
 2023   LayoutParam                   LSW_LAYOUT_PARAM
 2025   ProcessItem                   LSW_PROCESS_ITEM
 2026   ProcessItemLogVar             deprecated
 2027   ProcessLink                   LSW_PROCESS_LINK
 2028   ProcessLabel                  LSW_PROCESS_LABEL
 2029   ProcessItemPrePost            LSW_PROCESS_ITEM_PRE_POST
 2030   ReportPage                    LSW_REPORT_PAGE
 2031   ReportChart                   LSW_REPORT_CHART
 2032   ReportDatasource              LSW_REPORT_DATASOURCE
 2033   ReportDatasourceICLink        LSW_REPORT_DATASOURCE_IC_LINK
 2034   ReportDatasourceLayoutLink    LSW_REPORT_DS_LAYOUT_LINK
 2035   ReportVariable                LSW_REPORT_VARIABLES
 2036   ReportEpvLink                 LSW_REPORT_EPV_LINK
 2037   ReportTGLink                  LSW_REPORT_TG_LINK
 2038   ResourceBundle                LSW_RESOURCE_BUNDLE
 2039   ResourceBundleKey             LSW_RESOURCE_BUNDLE_KEY
 2040   SavedSearch                   LSW_SAVED_SEARCHES
 2041   ScoreboardReportLink          LSW_SCBD_RPT_LINK
 2043   ScriptLanguage
 2044   SyncQueue                     LSW_UCA_SYNC_QUEUE
 2045   UCABlackout                   LSW_UCA_BLACKOUT
 2046   UCAParam                      LSW_UCA_PARM
 2047   ProviderUser                  LSW_USR
 2048   User                          LSW_USR_XREF
 2049   UserAttribute                 LSW_USR_ATTR
 2050   UserAttributeDefinitionValue  LSW_USER_ATTR_DEF_VALUES
 2052   WebServiceOperation           LSW_WEB_SERVICE_OP
 2054   ParameterMapping              LSW_PARAMETER_MAPPING
 2055   ProcessParameter              LSW_PROCESS_PARAMETER
 2056   ProcessVariable               LSW_PROCESS_VARIABLE
 2057   ProcessGlobalVariableLink     deprecated
 2058   EpvProcessLink                LSW_EPV_PROCESS_LINK
 2059   ResourceProcessLink           LSW_RESOURCE_PROCESS_LINK
 2060   ExternalActivityParameter     LSW_EXTACT_PARAMETER
 2061   ExternalActivityProperty      LSW_EXTACT_PROPERTY
 2063   Branch                        LSW_BRANCH
 2064   Snapshot                      LSW_SNAPSHOT
 2065   Deployment                    LSW_DEPLOYMENT
 2066   Project                       LSW_PROJECT
 2068   Server                        LSW_SERVER
 2069   ProjectDependency             LSW_PROJECT_DEPENDENCY
 2070   ParameterMappingParent
 2072   BPDInstance                   LSW_BPD_INSTANCE
 2073   BPDInstanceData               LSW_BPD_INSTANCE_DATA
 2075   UserGroup                     LSW_USR_GRP_XREF
 2076   Release                       LSW_RELEASE
 2077   EnvironmentVariableValue      LSW_ENV_VAR_VAL
 2078   Task                          LSW_TASK
 2079   UserFavorite                  LSW_USER_FAVORITE
 2080   TaskAttachment                LSW_FILE
 2081   TaskNarrative                 LSW_TASK_NARR
 2082   TaskSendToList                LSW_TASK_ADDR
 2084   TaskExecutionContext          LSW_TASK_EXECUTION_CONTEXT
 2085   TaskInfopathFormData          LSW_TASK_IPF_DATA
 2086   ExternalTaskData              LSW_TASK_EXTACT_DATA
 2087   UserAssume                    LSW_USR_ASSUME
 2089   BPDNotification               LSW_BPD_NOTIFICATION
 2090   DependencyPath                LSW_DEP_PATH
 2091   POReference                   LSW_PO_REFERENCE
 2092   EnvironmentVariableDefault    LSW_ENV_VAR_DEFAULT
 2093   EnvironmentType               LSW_ENV_TYPE
 2094   EnvironmentVariable           LSW_ENV_VAR
 2095   RTReference                   LSW_RT_REFERENCE
 2097   TimePeriod                    LSW_TIME_PERIOD
 2098   TimeSchedule                  LSW_TIME_SCHEDULE
 2099   HolidaySchedule               LSW_HOLIDAY_SCHEDULE
 2100   TWAclEntry                    LSW_ACL_ENTRY
 2101   SmartFolder                   LSW_SMART_FOLDER
 2102   ReportDatasourceServiceLink   LSW_REPORT_DATASOURCE_SRV_LINK
 2103   Installation                  LSW_INSTALLATION
 2104   BlueprintSubscription         LSW_BLUEPRINT_SUBSCRIPTION
 2105   ReportRbgLink                 LSW_REPORT_RBG_LINK
 2106   EnvironmentVariableType       LSW_ENV_VAR_TYPE
 2107   ServerCapability              LSW_SERVER_CAPABILITY
 2108   CapabilityType                LSW_CAPABILITY_TYPE
 2109   SharedObject                  BPM_SHARED_OBJECT
 2110   SharedObjectInstance          BPM_SHARED_OBJECT_INSTANCE
 2111   SharedObjectValue             BPM_SHARED_OBJECT_VALUE
 2112   OSLCProvider                  BPM_OSLC_PROVIDER
 2113   BPDSoapHeader                 BPM_BPD_SOAPHEADER
 2114   EventSubscriptionType         BPM_EVENT_SUBSCRIPTION_TYPE
 2115   UCAEventType                  BPM_UCA_EVENT_TYPE
 2116   BPDInstanceMeasures           BPM_BPD_INSTANCE_MEASURES
 2117   BPMAsset                      BPM_ASSET
 2118   BPDActivityInstance           LSW_BPD_ACTIVITY_INSTANCE
 2119   UserAvatar                    BPM_USR_AVATAR
 2120   BPDInstanceCorrelation        LSW_BPD_INSTANCE_CORRELATION
 2121   BPDInstanceExtData            LSW_BPD_INSTANCE_EXT_DATA
 2122   BPDResourceLink               BPM_BPD_RESOURCE_LINK
 3000   Component
 3003   Coach                         LSW_COACH
 3004   CoachResource                 LSW_COACH_RESOURCE
 3005   CoachButton                   LSW_COACH_BUTTON
 3007   Exception                     LSW_EXCEPTION
 3008   ExitPoint                     LSW_EXIT_POINT
 3009   InvokeUCA                     LSW_INVOKE_UCA
 3010   Step                          LSW_STEP
 3011   Script                        LSW_SCRIPT
 3012   SubProcess                    LSW_SUBPROCESS
 3013   Switch                        LSW_SWITCH
 3014   SwitchCondition               LSW_SWITCH_CONDITION
 3015   TaskAction                    LSW_TASK_ACTION
 3016   TaskSender                    LSW_TASK_SENDER
 3017   TaskSenderExcludedVar         LSW_TASK_SENDER_EXVAR
 3018   TaskSenderAddr                LSW_TASK_SENDER_ADDR
 3019   TaskSenderFile                LSW_TASK_SENDER_FILE
 3020   TrackingPoint                 LSW_TRACKING_POINT
 3021   TrackedVariableUse            LSW_TRACKED_VARIABLE_USE
 3022   JavaConnector                 LSW_JAVA_CONNECTOR
 3023   WSConnector                   LSW_WS_CONNECTOR
 3024   ILOGConnector                 LSW_ILOG_CONNECTOR
 3025   SCAConnector                  LSW_SCA_CONNECTOR
 3026   ILOGDecision                  LSW_ILOG_DECISION
 3027   ICMCaseConnector              LSW_ICMCASE_CONNECTOR
 3028   CoachNG                       BPM_COACHNG
 3029   CoachNGBoundaryEvent          BPM_COACHNG_BOUNDARY_EVENT
 3030   ECMConnector                  BPM_ECM_CONNECTOR
 3031   StayOnPage                    LSW_STAY_ON_PAGE
 3032   CoachFlow
 5000   Repository
 6001   Contribution                  BPM_CONTRIBUTION
 6002   ContributionProperty          BPM_CTRB_PROPERTY
 6003   Artifact                      BPM_ARTIFACT
 6004   ContributionDependency        BPM_CTRB_DEPENDENCY
 6005   ProcessArtifactReference      BPM_PROC_ARTIFACT_REF
 6006   ClassArtifactReference        BPM_CLS_ARTIFACT_REF
 6007   BPDArtifactReference          BPM_BPD_ARTIFACT_REF
 6008   MonitorProjectInterchange     BPM_MON_MODEL_DATA
 6009   PCRegistration                BPM_REGISTRATION
 6010   RepositoryLog                 BPM_REPOSITORY_LOG
 6011   SharedToolKitUsage            BPM_SHARED_TK_USAGES
 6012   BPMSnapshotStatus             BPM_SNAPSHOT_STATUS
 6014   ProjectSubscription           BPM_PROJECT_SUBSCRIPTION
 6015   ProjectSubscribed             BPM_PROJECT_SUBSCRIBED
 6016   TaskMarker                    BPM_TASK_MARKERS
 6017   PCIndexAction                 BPM_PC_IDX_ACTION
 6018   PCIndexer                     BPM_PC_INDEXER
 6019   GovernanceEvent               BPM_GOVERNANCE_EVENT
 6020   GovernanceAssignment          BPM_GOVERNANCE_ASSIGNMENT
 6021   TWClassExtension              BPM_TWCLASS_EXTENSION
 6022   CaseProperty                  BPM_CASE_PROPERTY

IBM BPM 8.5.5 PO types table (PDW DB Part)


 PO_TYPE   Name                        PDWDB table  

 4000   SystemDefinition              LSW_SYSTEM
 4002   Task                          LSW_TASK
 4003   TrackedField                  LSW_TRACKED_FIELD
 4004   TrackedFieldUse               LSW_TRACKED_FIELD_USE
 4005   TrackedValue
 4006   TrackingGroup                 LSW_TRACKING_GROUP
 4007   TrackingPoint                 LSW_TRACKING_POINT
 4008   TrackingPointValue            LSW_TRACKING_POINT_VALUE
 4009   TimingIntervalValue           LSW_TIMING_INTERVAL_VALUE
 4010   TimingIntervalBound           LSW_TIMING_INTERVAL_BOUND
 4011   TimingInterval                LSW_TIMING_INTERVAL
 4012   LoadTrace                     LSW_LOAD_TRACE
 4013   User                          LSW_USR_XREF
 4014   Table                         LSW_TABLE
 4015   Column                        LSW_COLUMN
 4016   View                          LSW_VIEW
 4017   Snapshot                      LSW_SNAPSHOT

Thursday, July 2, 2015

Search API for custom saved search results only 500 results - (7.5.1.2, 8.0.1.x, 8.5.0.x, 8.5.5.x)

Problem Statement:
Recently we upgraded our IBM BPM servers to 7.5.1.2 and faced issue while using search API.

We are using REST-API to get list of task from custom Inbox. Though there were 1000+ results, API was just fetching 500 results only

Explaination:
When running a search in the process portal the value here is how many records are returned per search. If you expect more than 500 records for a call, then this number needs to be increased. An example is the TWSearch functtion. When using the saved search in an API format, you may expect to have more than the default of 500 rows returned. When using the saved search API, if you need more than 500 records returned, increase this number.

Solution:

add below block in 100Custom.xml

<properties>
 <server merge="mergeChildren">
  <process-search-engine-count-optimization merge="replace">500
  </process-search-engine-count-optimization>
 </server>
</properties>

Ref

http://www-01.ibm.com/support/docview.wss?uid=swg1JR52087

Wednesday, June 24, 2015

Authorization Error while doing offline deployment in IBM BPM PS

Problem :: Facing Error while doing offline deployment in IBM BPM PS servers. Error is 'You are not authorized to make changes to items in this context'.

We were doing offline deployment with very well established commands and commands which we use in other environments and working from long time.

Work Around ::
We raised PMR for same and after some investigation IBM team came back with details that there was problem in Database an entry for particular application and authorization.
Table - LSW_ACL_ENTRY
We need to check the entry for our project in this table which we can do by comparing below columns
LSW_ACL_ENTRY -> PO_ID
LSW_PROJECT -> Project_Id

And then check what is the User_id or group_id in the respective column of LSW_ACL_ENTRY. in our case user_id was 1 which means tw_autor user was having access to that processApp.

IBM team was not sure why it was like that as it should be user_id 3 which is tw_admin who should have access to application.

Now, catch is we were using tw_admin credentials to login to wsadmin console before doing deployment. and this user was not having access to application. at same time we cannot do deployment using tw_author as it is not an admin user.

As a workaround , We have added tw_author user in tw_admins group and completed our deployment using tw_author user which worked.

IBM Team is still not sure why this thing happened and they said they will investigate and come back with permanent solution as adding tw_author in tw_admins group is not a good idea.

I will update this post if we find any permanent solution.

Monday, June 1, 2015

IBM BPM PC servre throwing OOM error and High CPU usage after 7.5.1.2 upgrade from 7.5.1.1

Problem::

Getting OutofMemory error and High CPU usage of applicaiton server just after upgrading to IBM BPM 7.5.1.2

We have raised PMR to IBM for same and solution we got was as below.

Solution ::

After upgrading BPM 7.5.1.1 to 7.5.1.2 all snapshots will be some kind

of 'fixed'. Hence, those are loaded in the heap and could allocate a

lot of memory, depending on the amount. This operation is called

UserAttributeDefinitionRepair and is an one time operation. So when it

is completed once, it is not executed again. If the system crashes

during this operation, BPM tries to re-run it again and will probably

fail again.

One can verify, that this process is running, doing the following: To

check if the 'UserAttributeDefinitionRepair' is still running, please

check table LSW_SYSTEM and look for the PROPKEY

'UserAttributeDefinitionRepair'. If its PROPVALUE is not COMPLETED,

than the process is not finished yet.

In order to regulate the number of loaded snapshots one can adjust the

Branch Context Cache Size. We suggested to use the following action

plan:

1) Change the branch-context-max-cache-size to 64 and monitor the

system, if OOM occurs (testing now)

2) Change the branch-context-max-cache-size to 32 and monitor the

system, if OOM occurs,

3) Install the recommended fixes for BPMSnapshotCleanup and dependency

ifixes on top of 7.5.1.2.

http://www-01.ibm.com/support/docview.wss?uid=swg21669992

- 7512 tab

4) Run BPMSnapshotCleanup command as instructed to clean up unneeded

snapshots.

http://www-01.ibm.com/support/knowledgecenter/SSFPJS_7.5.1/com.ibm.wbpm.

main.doc/managinglib/topic/managing_snapshots_i.html?cp=SSFPJS_7.5.1

5) After clean up database, start server and monitor the system.

Steps 1 and 2 might be the most crucial. Reducing the cache size causes

to be not that much Snapshots be loaded in the heap at once. As a

result, the whole process will take longer, but it will also not fail.

This value can be adjusted after the process is once finished (see

above: PROPVALUE shows COMPLETED then).

Steps 3 to 5 are recommended in order to remove old, unused snapshots,

that influence the whole process. Keeping the system clean is a good

approach in general. Those cleaning operations are just available on

BPM 7.5.1.2 and not 7.5.1.1. See:

https://developer.ibm.com/answers/questions/185492/how-to-resolve-an-out

ofmemory-regarding-poversions/

In order to prevent the whole problem, you can use the following

process for further migrations from BPM 7.5.1.1 to BPM 7.5.1.2:

1) Identify the process apps and toolkits which have the largest numbers

of snapshots by running DB queries. Take note.

2) Repeat the following steps to each process app or toolkit will be

cleaned.

a) Create a new snapshot;

b) Export snapshot created in a);

c) Archive and delete process app or toolkit;

d) Re-import snapshot exported in b).

Note: If multiple versions of toolkit snapshots are referenced,

please do the following:

a1) Export all toolkit snapshots to keep one by one;

b1) Archive and delete the toolkit;

c1) Import toolkit snapshot in the desired sequence, import the

oldest snapshot first. Do NOT import them with dependent process apps

since it may potentially messed up the toolkit snapshot levels.

Thursday, May 28, 2015

All you want to know about IBM BPM Event Manager - Performance tuning

If anything most irritating in IBM BPM product is its lake of documentation of user manual for the product. I have spend long time on finding information about different component of IBM BPM and believe me its bit tough to find good article or manual.

Yesterday, I found a very good article on IBM BPM Event Manager by BP3 and it has almost everything we want to know about IBM BPM Event Manager.

Which includes topics like below.

Full Article - https://bp3.zendesk.com/hc/en-us/articles/202911143-Event-Manager-in-IBM-BPM-Standard-the-missing-manual

Event Manager Design

In the Event Manager (EM) design the database the master of everything.
The important Event Manager related table in BPMDB are:

lsw_em_instance - A row for each EM scheduler.
lsw_em_task - A row for each non-completed task, includes a reference to lsw_em_instance to indicate which scheduler owns each task.
lsw_em_task_keyword - One-to-many table mapping a task to its associated keywords
lsw_em_sync_queue - A row for each sync queue, includes a reference to lsw_em_instance to indicate which scheduler owns each sync queue.
lsw_uca_blackout - A row for each blackout period, including the next transitions into and out of blackout

The database knows what schedulers exist, what sync queues exist, what tasks exist, what states the tasks are in, etc. So, basically Event Manager uses the database’s transaction guarantees as much as possible to ensure a consistent view across all machines in a cluster. In addition, Event Manager uses the database’s system clock as the master, to avoid problems with time-syncing among machines in a cluster.

You can find full Article at below link which is very informative and intresting.

https://bp3.zendesk.com/hc/en-us/articles/202911143-Event-Manager-in-IBM-BPM-Standard-the-missing-manual

Saturday, May 23, 2015

what to do when a Service or BPD in loop in IBM BPM and kill process does not work

Question

During testing and development, a business process definition or service might accidentally enter into an infinite loop. What is the procedure to clean up these unnecessary instances and tasks and stop the looping?

Cause

IBM Business Process Manager is a development platform and has many of the same programming structures and features that are found in traditional programming, such as looping, recursion, and so on. Looping on a service or business process definition is possible. As with any looping event, an exit condition must exist. Sometimes during development or production runtime, an infinite loop can occur.
IBM Business Process Manager has a component called the Event Manager. The Event Manager moves tokens in the business process definition engine and the service engine. The Event Manager continues to process a looping event until the event manager is stopped or the loop stops.

Answer

http://www-01.ibm.com/support/docview.wss?uid=swg21622584