Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-3717

loss of precision for long long values in v1 index

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • 2.0.0-rc1
    • Affects Version/s: None
    • Component/s: Index Maintenance
    • None
    • Fully Compatible
    • ALL

      I think this
      double d = (double) n;
      if( d != n ) {

      needs to be this

      double d = (double) n;
      if( (long long)d != n ) {

      Test forthcoming.

            Assignee:
            dwight@mongodb.com Dwight Merriman
            Reporter:
            aaron Aaron Staple
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: