Math Is Fun Forum

jubadedo

Member

Registered: 2015-04-05

Posts: 19

Is this the correct result for this formula?

This is a way (I think) to convert binary strings to floating point using upper and lower bounds. I keep getting the answer 1.61225 and I literally type in the my calculator the numbers from the picture. For context the formula, takes the binary string (00110) representation of the value 6 with an upper bound of 7.3 and a lower bound of 1.5 with a binary string length of 5 and computes that value using the actual value 6 in the formula. Can someone explain what I'm doing wrong?

bobbym

bumpkin

From: Bumpkinland

Registered: 2009-04-12

Posts: 109,606

Re: Is this the correct result for this formula?

Hi;

It is kind of small and hard to see but I read it as

I am getting 1.612258064516129 also. Seems like an error in his calculations.

---

In mathematics, you don't understand things. You just get used to them.
If it ain't broke, fix it until it is.
Always satisfy the Prime Directive of getting the right answer above all else.

Relentless

Member

Registered: 2015-12-15

Posts: 631

Re: Is this the correct result for this formula?

Hi guys,

If you multiply the fraction by 6 instead of 0.6, you get the answer in the picture. It seems that .6 meant times six, not shorthand for 0.6.

Last edited by Relentless (2016-01-22 16:17:19)