taskManeage - Tasks: task #15497, Adding a verification step

 
 

You are not allowed to post comments on this tracker with your current authentication level.

task #15497: Adding a verification step

Submitter:  Mohammad Akhlaghi <makhlaghi>
Submitted:  Mon 23 Dec 2019 06:36:53 PM UTC
   
 
Should Start On:  Mon 23 Dec 2019 12:00:00 AM UTC Should be Finished on:  Mon 23 Dec 2019 12:00:00 AM UTC
Category:  Analysis Priority:  5 - Normal
Status:  Postponed Privacy:  Public
Assigned to:  makhlaghi Percent Complete:  100%
Open/Closed:  Closed Effort:  0.00

Wed 01 Jan 2020 08:12:05 PM UTC, comment #1: 

A verification step for all necessary outputs has been added into the template's infrastructure as a new `verify.mk' analysis Makefile. It has been pushed to the main repository. See the commit message (and updated parts in `README-hacking.md') for more.

Mohammad Akhlaghi <makhlaghi>
Group administrator
Mon 23 Dec 2019 06:36:53 PM UTC, original submission:  

Currently the only verification that the template provides is the published PDF. Users will have to manually look into the published and generated PDFs (numbers, plots, tables) and see if they obtained the same result.

Verification is an important step that we should also add after the analysis is complete (possibly as a `verify.mk' file that is loaded before `paper.mk'). Users can use that Makefile to add rules for verifying their output datasets (that go into the paper's plots and figures for example).

We'll just have to add some guiding comments on best practices in verifying, for example if the file is timestamped (the date and time that it was created is included in it, for example as commented lines in a table), its important to remove the timestamp (maybe all commented lines) when verifying it with a saved checksum.

This came up to me after reviewing a paper on The Popper Convention for a paper I am writing on this template. It introduces concepts very much like those within this template, but I only recently learnt about it (early versions of this template date back to the 2015 NoiseChisel paper). Its great to show that other people (and they are computer scientists!) have independently come up with the same principles/convention as ours (implemented in a very different way!).

Mohammad Akhlaghi <makhlaghi>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by makhlaghi (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

     

    Follow 3 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2020-01-01 makhlaghi Percent Complete0% 100%
        Assigned toNone makhlaghi
        Open/ClosedOpen Closed

    Back to the top

    Powered by Savane 3.13-02a9.
    Corresponding source code