Reply to thread

Message: <blockquote data-quote="lmo10" data-source="post: 6330" data-attributes="member: 2494"><p>I am very new to VB.Net and as a first project I am trying to build a calculator similar to the windows scientific calculator. I have a specific problem when I try to convert a binary Qword to decimal. I am using this loop:</p><p></p><p><span style="font-size: 10px"><span style="color: #0000ff">Public</span></span><span style="font-size: 10px"><span style="color: #0000ff">Function</span></span><span style="font-size: 10px"> BTD(</span><span style="font-size: 10px"><span style="color: #0000ff">ByVal</span></span><span style="font-size: 10px"> Bin </span><span style="font-size: 10px"><span style="color: #0000ff">As</span></span><span style="font-size: 10px"><span style="color: #0000ff">String</span></span><span style="font-size: 10px">) </span><span style="font-size: 10px"><span style="color: #0000ff">As </span></span><span style="font-size: 10px"><span style="color: #0000ff">String</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span><span style="font-size: 10px"><span style="color: #0000ff">Dim</span></span><span style="font-size: 10px"> i </span><span style="font-size: 10px"><span style="color: #0000ff">As</span></span><span style="font-size: 10px"><span style="color: #0000ff">Integer</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span><span style="font-size: 10px"><span style="color: #0000ff">Dim</span></span><span style="font-size: 10px"> Dec </span><span style="font-size: 10px"><span style="color: #0000ff">As </span></span><span style="font-size: 10px"><span style="color: #0000ff">Long</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span><span style="font-size: 10px"><span style="color: #0000ff">For</span></span><span style="font-size: 10px"> i = Bin.Length </span><span style="font-size: 10px"><span style="color: #0000ff">To</span></span><span style="font-size: 10px"> 1 </span><span style="font-size: 10px"><span style="color: #0000ff">Step</span></span><span style="font-size: 10px"> -1</span></p><p><span style="font-size: 10px"></span></p><p><span style="font-size: 10px"></span><span style="font-size: 10px"><span style="color: #0000ff">If</span></span><span style="font-size: 10px"> Mid(Bin, i, 1) </span><span style="font-size: 10px"><span style="color: #0000ff">And</span></span><span style="font-size: 10px"> 1 </span><span style="font-size: 10px"><span style="color: #0000ff">Then</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span><span style="font-size: 10px">Dec = Dec + 2 ^ (Bin.Length - i)</span></p><p><span style="font-size: 10px"></span></p><p><span style="font-size: 10px"></span><span style="font-size: 10px"><span style="color: #0000ff">End</span></span><span style="font-size: 10px"><span style="color: #0000ff">If</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span><span style="font-size: 10px"><span style="color: #0000ff">Next</span></span><span style="font-size: 10px"> i</span></p><p><span style="font-size: 10px"></span></p><p><span style="font-size: 10px">keyData = Dec</span></p><p><span style="font-size: 10px"></span></p><p><span style="font-size: 10px"></span><span style="font-size: 10px"><span style="color: #0000ff">End</span></span><span style="font-size: 10px"><span style="color: #0000ff">Function</span></span></p><p></p><p><span style="font-size: 10px"><span style="color: #0000ff">Using the Long Data Type I get an Arithmetic Overflow Exception and if I use the String Data Type the result for DEC is in scientific notation (xx+Exx) with this as a value I dont know how to translate it back to a numeral that can be used in converting to another base (say the user wants to convert the value to hex after converting from binary to decimal). So my question is how do I handle large numbers like this? </span></span></p><p></p><p><span style="font-size: 10px"><span style="color: #0000ff">i.e:</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff">If the original Binary Qword value is equivalent to 2^64 the decimal number would be "18446744073709551616" which is too large for the Long Data Type.</span></span></p><p></p><p><span style="font-size: 10px"><span style="color: #0000ff">Is the loop I am using correct for this situation(It works for Dword values) or should I rethink the approach as a whole?</span></span></p><p></p><p><span style="font-size: 10px"><span style="color: #0000ff">Note The windows calculator handles these correctly If someone knows how its done in the windows calc please let me know. I am just starting out with VB.Net so any guidenece will be appreciated.</span></span></p><p><span style="font-size: 10px"><span style="color: #0000ff"></span></span></p></blockquote><p></p>

Verification

This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.

Accept Learn more…

Top Bottom