Batch Update by Data Export and Import

You can upload data to Calem via excel files, or batch update existing data via excel files. I will focus on the points to pay attention to when you batch update existing data via excel files.


1. Data Upload

Calem provides a few ways to upload data based on your business requirements:

  • Manual upload from an exported file
  • Manual upload from an excel template
  • Batch upload from command line
  • Scheduled upload

Data Validation Configuration

By default Calem Enterprise Upload utility will verify lookup values and will fail the upload if a lookup value is invalid. For instance, a location of an asset is not found in Calem when uploading an asset with a reference to that location. Calem will fail the upload.

Alternatively, you may turn off the data validation so that Calem will create missing lookup values. If the creation is successful the upload will go through successfully.

Here is the recommendation about the data validation configuration:
  • ​The data validation should be left enabled by default all the time. This is important so data would not be added to your service by accident. For instance, a location "Server-Central" was misspelled as "Server_Central", a new location "Server_Central" will be added if the validation was turned off.
  • You may turn off validation at initial data population. This will be a saving if you let Calem add missing lookup values initially. For instance, you are upload a user with job role "Electrician", instead of manually creating "Electrician" before a user can be uploaded, you may have Calem create "Electrician" in the job role object automatically by turning off the data validation.
  • The validation should be left on for "Batch Update" to be discussed below.
You can manage the data validation by adding the following configuraiton in your "server/conf/calem.custom.php":

//Lookup reference validation is required (true), or auto-added (false) 
$_CALEM_dist['calem_data_upload']['validate_ref_id']=true;


2. Batch Update

​In Calem release R10 you can batch update data through data export and import. This is recommended approach to update multiple data rows.

Here are the steps:

  • To update data the key correct field or fields must be included for upload to be successful.
    • One simple approach is to include "id" field in the export. The "id" field uniquely identify a data row so you don't need to figure out if correct key field or fields are included in the export.
    • You can include the "id" field through "Customize" button in a report list.
    • The "id" is an internal key field for a data row and is generated by Calem to be unique when data is created. If you are creating data through upload, do not populate "id" field.
  • Use a report list to export data to be updated. For instance, "Asset module | Report | Asset report list". 
    • Narrow down the list through search before exporting the list.
    • If the report list does not include the fields you need to change or add. Customize the report list to include the fields you need (see Admin Guide for report customization). 
  • Edit the excel file and save changes. 
  • Upload the excel file to the database. The menu path is "Integration module | Data Upload"


Customers of CalemEAM can reference "Calem Enterprise Data Upload Guide" at Support Site for more information.

Asset Grouping in R10
Custom Fields for Dropdown and Lookup