Searched refs:digitization_error (Results 1 – 1 of 1) sorted by relevance
6710 const char *name, double digitization_error) in transform_range_check() argument6719 double in_min = ceil((in-err)*max - digitization_error); in transform_range_check()6720 double in_max = floor((in+err)*max + digitization_error); in transform_range_check()6770 double digitization_error; in transform_image_validate() local6794 digitization_error = .5; in transform_image_validate()6813 digitization_error = .5; in transform_image_validate()6819 digitization_error = .5 * 257; in transform_image_validate()6886 digitization_error); in transform_image_validate()6893 digitization_error); in transform_image_validate()6900 digitization_error); in transform_image_validate()[all …]