*******************************
DARPA NeoVision2 FOUO
*******************************

NeoVision2 Evaluation Software v2.2, SET Corporation All Rights Reserved 2011. 
Developed by Dr. Yang Ran, Amon Ducao at SET Corporation, an SAIC company.

v2.2

Change Log:
09-29-2011: bug fixed for console app.
09-27-2011: bug fixed for processing multiple DCRs.
09-20-2011: v1.0 released.
10-07-2011: v1.4 released
10-12-2011: v1.5 released
10-22-2011: v2.0 released
11-02-2011: v2.1 released to fix bugs when handling targets with <30 linear pixels as well as when counting occluded targets from the ground-truth files.
12-04-2011: v2.2 released to fix bugs for over-penalizing detections that match the occluded and ambiguous groundtruth targets.

Intro:
    This Windows based command line application reads two csv files and calculates the scores for all Neo2 object classes:"All", "Car", "Truck", "Tractor-Trailer", "Bus", "Container", "Boat", "Plane", "Helicopter", "Person", "Cyclist".

Usage:
     NeoVision2Console.exe groundtruth.csv systemoutput.csv result.csv confidence_threshold(optional, default at 0.0)
     -groundtruth.csv: a csv file to store the groundtruth 
     -systemoutput.csv: a csv file to store the system output. Please note that in the current version this file needs to have the same frame # as the groundtruth, i.e., one to one frame correspondence. More flexible support will be provided later.
     -result.csv: an output file which will contain the scores. Please change the filename accordingly to avoid overwrite.
     -confidence: a floating number (0.0 to 1.0) to threshold the detections. 0.0 will include all detections.

Output:
     It will output the following scores for each class to the screen and to the output file (result.csv):
     Class, GT#, Det#, FN#, FP#, # of Frames, NMOTDA 
     Based on the above numbers, the NMODTA and Pd, Pf will be calculated.

For bugs, issues and wishlists, please send email to
yran@setcorp.com and aducao@setcorp.com

Thank you!