Searched refs:digitization_error (Results 1 – 1 of 1) sorted by relevance
6712 const char *name, double digitization_error) in transform_range_check() argument6721 double in_min = ceil((in-err)*max - digitization_error); in transform_range_check()6722 double in_max = floor((in+err)*max + digitization_error); in transform_range_check()6772 double digitization_error; in transform_image_validate() local6796 digitization_error = .5; in transform_image_validate()6815 digitization_error = .5; in transform_image_validate()6821 digitization_error = .5 * 257; in transform_image_validate()6888 digitization_error); in transform_image_validate()6895 digitization_error); in transform_image_validate()6902 digitization_error); in transform_image_validate()[all …]