- Preparation: Create database
- Create the Channel
- Tutorial Instructions
- Complete Sample Code
- More Information
In this article we will use conn:execute{}
to insert patient data from a JSON message into a database.
You can use the same method to copy data from of the different types of node trees and insert it into a database.
These are the steps:
- Preparation: Use the From Translator component to import and queue the JSON message data
- Note: This step is simulated by using sample data
- Preparation: Parse the message into a source JSON tree structure
- Note: Unlike HL7, XML etc a JSON tree structure is a Lua table not a node tree
- Insert into the database
This tutorial only addresses the last step, the preparatory steps have already been completed for you. To run this channel you would need to complete the first step, see the tutorial Reading from files: JSON in this section.
We recommend that you type in the code for each step, but we also include complete Sample Code if you prefer to paste it in and follow along.
Note: The code in this tutorial executes an INSERT statement for every message that is processed. It does not check if a record already exists, therefore if you attempt to insert duplicate records (with the same patient-id) the code will produce errors.
To handle duplicate messages you need to use conn:merge() or add logic to check for duplicates, see the Save to Database: JSON to DB tutorial in the Interface Tutorials section.
Preparation: Create the “test” database [top]
If you do not already have a SQLite database called “test” in the Iguana install directory, then you can create it by following the instructions in the Create a SQLite DB to match your VMD tutorial.
Create the Channel [top]
- Create a Channel with the the following settings:
- Source = From Translator
- Destination = To Translator
- Channel name = Insert JSON into Database
- Click the Add Channel button to create the channel.
Ignore the red warning messages, see resolving the milestone configuration error. - Open the Translator by clicking the Edit Script link at the bottom of the Destination tab.
- Download and import the Insert_JSON_into_Database_To_Translator.zip project file.
This file contains a skeleton project and six sample JSON messages. - Iguana will load the project and data into the Translator, your screen should look like this:
Tutorial Instructions [top]
- Pass the message data to the script.
- Iguana automatically passes the message data to the
main()
function - The message can be accessed using the
Data
parameter - No action is needed
- Iguana automatically passes the message data to the
- Create a database connection object, using the db.connect{} function.
Add the following code to your script:
- Click on the table object to view the first sample message:
- Use the data from the first sample message to hard-code a SQL INSERT statement.
Add the following code to your script:
Note: The double square brackets [[ ]] on lines 18 and 33 are the Lua terminators for a multi-line string. - Test that the query works by running it using
Conn:execute{}
and then viewing the inserted data.
Add the following code, then click on the result of the SELECT query to view the patient data:
As you can see the patient record has been inserted correctly. - Comment out the DELETE statement to see what happens when we try to insert a duplicate record:
The expanded message tells that a cryptic reference that a “constraint failed”, which basically means that we are not allowed to insert the same patient record twice.
Note: Technically the constraint is the primary key on the Id (which prevents duplicate patient records with the same Id), and the failure is because we tried to insert a patient record with a duplicate Id.
- Uncomment the DELETE statement.
- View the hard-coded SQL statement string in the
SqlInsert
variable.
Add atrace()
and click the string annotation to view it:
- Now we will reproduce the same INSERT query but replacing the hard-coded VALUES with concatenated data from the JSON message.
- Make a second copy the
SqlInsert
immediately below thetrace()
statement. - Modify it as shown so the Id value is copied from the Msg variable (JSON data).
- Add a
trace()
and click the string annotation to view it:
Note: At this pointConn:execute{}
returns an error because the query is incomplete, this will disappear after we add the other VALUES. - Reproducing the other VALUES is just more of the same.
Add these three lines of code to code the query:
Note: The newline (\n) and 3 extra spaces at the start of lines 50 to 53 are only for formatting, so it is easy to compare the strings visually (the query will work equally well if they are removed). - View the query string to confirm that it matches the original query.
Add atrace()
and click the string annotation to view it:
- Delete the initial hard-coded
SqlInsert
string, and thetrace()
below it:
- Make a second copy the
- Test the code by adding the six sample messages to the database.
- Click on the SELECT query result to confirm that there is currently a single patient (Tracy Smith):
- Comment out the DELETE statement, so we can add all six rows:
You can safely ignore any errors about trying to insert duplicate records. - Navigate through the sample data to insert add the other messages.
Click next message button on the toolbar five times:
- Comment out the INSERT statement, to prevent errors from displaying:
- Click on the SELECT query result to confirm that the messages were added:
- Click on the SELECT query result to confirm that there is currently a single patient (Tracy Smith):
- Delete the test code:
- Add the database insert statement:
Note: If you attempt to insert duplicate patient records (with the same patient-id) this code will produce errors.
To handle duplicate messages you need to use conn:merge() or add logic to check for duplicates, see the Save to Database: JSON to DB tutorial in the Interface Tutorials section.
Complete Sample Code [top]
Here is the completed mapping code that you can cut and paste into your script:
function main(Data) -- Parse the JSON message local Msg = json.parse(Data) -- (1) connect to the database if not Conn or not Conn:check() then Conn = db.connect{ api=db.SQLITE, name='test', user='', password='', live=true } end -- (2) create insert query string local SqlInsert = [[ INSERT INTO patient ( Id, LastName, GivenName, Ssn ) VALUES ( ]].. "'"..Msg.patients["patient-id"].."',".. "\n '"..Msg.patients["last-name"].."',".. "\n '"..Msg.patients["first-name"].."',".. "\n '"..Msg.patients["social-security-no"].."'".. '\n )' -- (3) Insert data into database -- Note: This insert statement will fail and raise -- an error for any duplicate patient record Conn:execute{sql=SqlInsert, live=true} end
More Information [top]
- See our other interface tutorials in this section
- See our general tutorials section
- See our code samples section