 How To Generate Csvpaths

FlightPath Data can generate csvpath validation and/or upgrading statements based on sample data and any instructions. It is possible to provide a business context and/or business rules and receive back a working set of one or more statements.

In practice, while the validation FlightPath provides will execute correctly, it typically takes more engagement to create the ideal validation or upgrading for your use case. It is also possible that you may want to adjust the grain of the statements. In many cases, though not all, including only one rule per csvpath can simplify development and testing.

How to do it

• Open FlightPath and check that your AI config is correct like this.
• Open examples/duplicates/Alzheimers_Disease_and_Healthy_Aging_Data_sample.csv
• Click on the AI tab at the top of the right-hand column
• Select the Create activity
• Enter a name and instructions:

    Create validation rules that fit this sample. Also include these three rules, on top of those you identify for yourself.
        - LocationAbbr and LocationDesc can only be states, Puerto Rico, or the District of Colombia unless there is a value in Data_Value_Footnote or LocationID is greater than 99
        - Data_Value_Unit and Data_Value_Type must make sense together
        - StratificationID1 and Stratification1 must make sense together
  

• Click submit and see the request appear in the list below with a yellow dot signifying the work is active
• As the request processes, see the Help and Feedback area for tabs giving ongoing status information. These tabs can be closed or ignored. Click the request name to reopen them.
• When the reply is available, the status dot by the request’s name goes green.

• Click the name to open the results in the Help and Feedback tabs. Right-click on the Results tab and select Save as.

• In the save name dialog be sure to change the file extension to .csvpath from .txt

• Open the new csvpath and run it against the data in Alzheimers_Disease_and_Healthy_Aging_Data_sample.csv. You can add the test-data: directive in the leading comment of csvpaths before hitting ctrl-r to run; otherwise, you will be prompted to choose a data file and the directive will be added for you.

Since you may receive a sizable number of small csvpaths in response to your request, you may want to ask for comments to be included. Alternatively, you can request a breakdown or build-up explanation using the Explain activity.