Poll: Was this article helpful for you?
You do not have permission to vote in this poll.
Yes
100.00%
1 100.00%
No
0%
0 0%
Total 1 vote(s) 100%
* You voted for this item. [Show Results]

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Getting accurate results when working with integers in Ruby
#1
After reading the official Ruby 3.0.0 documentation I have discovered that there are 2 ways to get the square root of a number.
When working with small numbers, both options return the same results,
but when the numbers get bigger the results of Option 2 may be inaccurate as follows:

Option 1:


Quote:Num1 = Integer.sqrt(10**46)
puts Num1


This will put exactly 100000000000000000000000 on the screen.

Option 2:


Quote:Num1 = Math.sqrt(10**46).floor
puts Num1


This will put 99999999999999991611392 on the screen.
Also follow me on Youtube for videos about video games:
https://www.youtube.com/channel/UCxfkGVU...2mQ/videos
Reply


Messages In This Thread
Getting accurate results when working with integers in Ruby - by Qomplainerz - 02-27-2021, 07:35 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Everything you need to know about Ruby Qomplainerz 0 875 07-25-2023, 09:53 AM
Last Post: Qomplainerz
  Additions in Ruby Qomplainerz 0 1,724 03-14-2021, 10:13 AM
Last Post: Qomplainerz
  Subtractions in Ruby Qomplainerz 0 1,645 03-08-2021, 11:42 AM
Last Post: Qomplainerz
  Predecessor in Ruby Qomplainerz 0 1,766 02-28-2021, 10:31 AM
Last Post: Qomplainerz
  Successor in Ruby Qomplainerz 0 1,722 02-28-2021, 10:29 AM
Last Post: Qomplainerz
  Least common multiple in Ruby Qomplainerz 0 1,827 02-28-2021, 09:11 AM
Last Post: Qomplainerz
  Floor and precisions in Ruby Qomplainerz 0 1,778 02-28-2021, 08:40 AM
Last Post: Qomplainerz
  Ceil and precisions in Ruby Qomplainerz 0 1,788 02-28-2021, 08:35 AM
Last Post: Qomplainerz
  Quotients and remainders in Ruby Qomplainerz 0 2,016 02-27-2021, 08:51 AM
Last Post: Qomplainerz
  Getting the currently installed Ruby version Qomplainerz 0 1,782 02-26-2021, 08:23 AM
Last Post: Qomplainerz

Forum Jump:


Users browsing this thread: 4 Guest(s)