Generic CSV Data File Formats for Laboratory Test Data in PAM

 Download an example CSV file

PAM offers the ability to work with "Generic CSV" files for Soil, Leaf, Sap and Nutrient Depletion test results. The CSV files which will be imported by PAM for these tests need to be in a specific format. These file formats can be both imported and exported.

What is a CSV File?

CSV is a file extension which stands for "Comma Separated Values". It’s a file format that many spreadsheet programs such as Microsoft Excel can work with. It works by organising data as a table, with a number of rows and columns (just as in a spreadsheet). The CSV file itself is a plain text file, which can be viewed using your favourite text editor (such as Notepad), although it probably won’t make much sense.

  • Each row in the data table is represented as a line of text in the CSV file.
  • The values in the columns of each row are represented as plain text, with columns separated by commas or spaces.
  • Where the data in a column contains a comma or a space, it is enclosed in double quotes.

  • NEW in 2016 - We added a new MANDATORY column "Test Depth" see the example CSV file for placement (between Sample Date and Site!) 

EG:

csv

 

 

 

Column Headings

For Laboratory test data, the first row of the CSV file is assumed to contain column heading information. If it does not, it should be left blank, as the importer disregards this first row, and any data in it will be lost (not imported).

Geographical Location Data

Rows in the CSV file can contain geographical location information – a latitude and longitude that specify the exact place at which a test was taken. If geographical information is included in the CSV file:

  • It MUST be in the first two columns in the files
  • The first column must be the latitude of the point, expressed in decimal degrees with latitudes south of the equator being less than zero1
  • The second column must be the longitude of the point, expressed in decimal degrees with longitudes west of Greenwich being less than zero.

These two columns may be omitted if no geographical location data are available.

Data Header Columns

The four columns following the geographical location information, if it is present, or the first four columns in the CSV file if not, contain header information about test sites which is used for ALL laboratory test information. These columns must be present, and must be contain data in the following order:

  1. Field ID
    Text which specifies a name for the field (paddock) in which this test was carried out. It doesn’t need to match the paddock names on your farm, although it would obviously be preferable if it did.
  2. Sample No.
    Text that specifies a sample number assigned by the laboratory to a test sample.
  3. Site
    Up to 20 characters which are used as a label for the test site if geographic coordinates are provided for the test.
  4. Sample Date
    The date the sample was taken. This needs to conform to your system short date format, which can be set via the control panel, and which normally defaults to US date format (mm/dd/yy).

Test Result Data

The remaining columns within the CSV file hold test result data, comments about them, and notes about the entire set of tests performed at a particular site. The results can be either text or numeric.

Numeric results may have associated comments. These are stored in a separate field. The comments field :

  • Can contain up to 20 characters of text
  • MUST have the same name as the result column , with the addition of the text " – COMMENT". Note the spaces – it is "(space)-(space)COMMENT". Column names are case insensitive, so the heading of the Comments columns may be in any combination of upper- and lower-case.
  • Must come AFTER the result column to which it relates. Ideally, it will be the column immediately following the result column.

Because of the way that test result data are stored, text columns may not have associated comments. Text columns may contain up to 20 characters.

A special column heading of NOTES is used for a column containing notes which relate to an entire suite of tests for a site. These notes might contain (for example) a recommendation for action to improve a paddock’s soil condition or productivity.

 

 

1. Can I change a Paddock Name ?

2. How do I merge 2 paddocks into 1 ?

3. How do I set up fertiliser for liquid application ?

4. How do I split 1 paddock into 2 ?

5. Our lists need tidying up… over the years we have doubled up on entries and miss-spelled some. How do we tidy them up?

6. Unable to edit a paddock - error "This Farm/Pdk combination exists, please try..."

7. What is the difference between Arable, Grazable, Workable and Irrigated Areas when setting up a Paddock ?

 

1. Can I change a Paddock Name ?

Yes...

Via the Configuration Menu

   Select Farm and Paddock List

   Tools / Paddock / Edit

   Enter the new name for your paddock.

 


 

2. How do I merge 2 paddocks into 1 ?

   From the Configuration menu, Select Farms & Paddocks List;
   Select the Old Paddocks;
   Select the general details TAB and deselect 'Include in current paddock list', also supply the date that the paddock were retired ;
   Create the new paddocks as normal.

If you want to keep the name you used for the original paddocks ("Fred's") as one of the names for the new sections ... Rename the old paddock to "Fred's Old" ... Use Tools / Paddocks / Edit

How do I handle this in the mapping section? 

We suggest you do this:
   Create a new Layer (in your Layer Manager) call it "Old Paddocks";
   Select the paddocks that are becoming redundant & Using "Tools" / "Move object to another layer" … move them one at a time (if there's more than one) to the "Old Paddocks" layer;
   Now on your map … draw the new paddock polygons. 
   Create the data links in PAM for the new paddocks in the usual way.

What about in reports ... 

In Paddock-Season reports you will see a choice to "Show Only Current" paddocks in the pick list of paddocks. That is, you can exclude or include old paddocks in any of those reports. 

In the Paddock Statistics (eg. Paddock Areas) reports ... Old paddocks are excluded. 

 


 

3. How do I set up fertiliser for liquid application ?

You can only have a liquid application if the purchase unit is a liquid also, so:

To set up the purchase unit as a liquid... you can either:

   Use the default liquid units that are supplied when entering your fertiliser, then purchase 1000 litre lots (tonne by volume)

or

   Create your own unit by following these instructions:
- Configuration / Customise PAM / Units
- Select 'Add...'
- Enter the long and short name of the unit ie: Liquid Tonne
- Enter the type as liquid
- Then you can enter the quantity (in litres) as 1000

   The Liquid Tonne option will now be available from the 'Purchase Unit' selection in the Fertiliser edit screen

   All application units will then be in litres for the specific fertiliser

 


 

4. How do I split 1 paddock into 2 ?

   From the Configuration menu, Select Farms & Paddocks List;
   Select the Old Paddock;
   Select the general details TAB and click the check box to tell PAM that the Paddock is no longer required in the Paddock Pick-List;
   Create the new paddocks as normal.

If you want to keep the name you used for the original paddock ("Fred's") as one of the names for the new sections ... Rename the old paddock to "Fred's Old" ... Use Tools / Paddocks / Edit 



How do I handle this in the mapping section? 

We suggest you do this:
   Create a new Layer (in your Layer Manager) call it "Old Paddocks";
   Select the paddocks that are becoming redundant & Using "Tools" / "Move object to another layer" … move them one at a time (if there's more than one) to the "Old Paddocks" layer;
   Now on your map … draw the new paddock polygons. 
   Create the data links in PA for the new paddocks in the usual way.



What about in reports ... 

In Paddock-Season reports you will see a choice to "Show Only Current" paddocks in the pick list of paddocks. That is, you can exclude or include old paddocks in any of those reports. 

In the Paddock Statistics (eg. Paddock Areas) reports ... Old paddocks are excluded. 

 


 

5. Our lists need tidying up… over the years we have doubled up on entries and miss-spelled some. How do we tidy them up?

   If it is simply a matter of correcting spelling, click Tools then Edit to edit names. 

   If your problem extends to having multiple versions of the one item (eg. “Super”, “SUPER”, “Superpos”, “Superphosphate” etc) then Go to: Utilities/Database Maintenance/Merge Configuration List Items

 


 

6. Unable to edit a pdk - error "This Farm/Pdk combination exists, please try..."

The problem is a leading or trailing space in the name. Unfortunately it's not easily solved by deleting the offending space. Change the name of paddock to something new, save it, re-edit it and change to the original name.

e.g. 
If paddock was called "Freds ", rename it to "Fredsx", save it, then rename it to "Freds"

 


 

7. What is the difference between Arable, Grazable, Workable and Irrigated Areas when setting up a Paddock ?

 

   Total Area... Size of paddock including Head lands, roads etc...

   Arable Area... total area that can be 'Cropped' in a paddock (Cropping)

   Cropped.. total area of the padock that has been sown (Cropping)

   Grazable Area... total area that can be 'Grazed' in a paddock (Livestock)

   Workable Area... total area that can be 'Worked' in a paddock (Machinery)

   Irrigated Area... total area that will be 'Irrigated' in a paddock (Irrigation)

 

Coogee Commercial Centre
3/83 Mell Road, (PO Box 7041)
Spearwood, Western Australia, 6163

T: +61-8-9 367 5814

F: +61-8-9 367 5823

E: This email address is being protected from spambots. You need JavaScript enabled to view it.

W: www.fairport.com.au