Wayback Machinekoobas.hobune.stream
May JUN Jul
Previous capture 12 Next capture
2021 2022 2023
1 capture
12 Jun 22 - 12 Jun 22
sparklines
Close Help
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
  • Asset Store
  • Get Unity

UNITY ACCOUNT

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account
  • Blog
  • Forums
  • Answers
  • Evangelists
  • User Groups
  • Beta Program
  • Advisory Panel

Navigation

  • Home
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
    • Blog
    • Forums
    • Answers
    • Evangelists
    • User Groups
    • Beta Program
    • Advisory Panel

Unity account

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account

Language

  • Chinese
  • Spanish
  • Japanese
  • Korean
  • Portuguese
  • Ask a question
  • Spaces
    • Default
    • Help Room
    • META
    • Moderators
    • Topics
    • Questions
    • Users
    • Badges
  • Home /
avatar image
1
Question by Althius · Aug 22, 2016 at 05:07 AM · c#unity 5valueformulaincorrect

Differance in formula results in Open Office spreadsheet and Unity

I'm getting different results in Unity(using C#), than my formula in OpenOffice Calc. FormulaAndResults

(Formula with inputs and results above.)

 public static int Formula(int i, int j)
 {
     return i - ((int)((float)(j / 2) * ((j - 1) * 6) + 1) - ((j - 1) * 6)) + 1;
 }

(Formula in Unity)

For example if I have i = 9 and j = 3 returns 9 in Unity while I am expecting it to return 3, while i = 2, j = 2 or j=24, j=4 returns the correct value.

Is there something difference about how the formula is calculated in C# or do I have to restructure the formula.

formula.png (67.4 kB)
Comment
Add comment
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

1 Reply

· Add your reply
  • Sort: 
avatar image
2
Best Answer

Answer by saschandroid · Aug 22, 2016 at 07:14 AM

That's because you divide integers: 3/2 = 1 ... You have to cast to float like this ( (float)j/2 ).

Comment
Add comment · Show 2 · Share
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image Bunny83 · Aug 22, 2016 at 07:34 AM 1
Share

Futhermore the foruma can be simplified quite a bit:

 return (int)(i- (j*0.5f-1f)*((j-1f)*6f);

The term "((j - 1) * 6)" is redundant. It can be moved into the first bracket as "-1". Further more the two "+1" cancel each other out. By using float constants you don't need to explicitly cast to float.

Note: you might want to use $$anonymous$$athf.RoundToInt ins$$anonymous$$d of the int cast at the end. This ensures that if the result is slighly below the closest integer it isn't one off since 3.9999 casted to int is "3" not "4"

avatar image Althius · Aug 22, 2016 at 09:26 AM 1
Share

Thanks saschandroid. I thought I'd had the (float) there at one point trying things out, looks like I didn't. And thanks Bunny83 I knew that formula was bit bigger than it needed to be.

Your answer

Hint: You can notify a user about this post by typing @username

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this Question

Answers Answers and Comments

6 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Multiple Cars not working 1 Answer

Distribute terrain in zones 3 Answers

Problem with curved Cornered Spline that i need help with 0 Answers

Serializable class definition in base class doesn't show in editor 1 Answer

How to make buttons have sound when it is highlighted and clicked? 0 Answers


Enterprise
Social Q&A

Social
Subscribe on YouTube social-youtube Follow on LinkedIn social-linkedin Follow on Twitter social-twitter Follow on Facebook social-facebook Follow on Instagram social-instagram

Footer

  • Purchase
    • Products
    • Subscription
    • Asset Store
    • Unity Gear
    • Resellers
  • Education
    • Students
    • Educators
    • Certification
    • Learn
    • Center of Excellence
  • Download
    • Unity
    • Beta Program
  • Unity Labs
    • Labs
    • Publications
  • Resources
    • Learn platform
    • Community
    • Documentation
    • Unity QA
    • FAQ
    • Services Status
    • Connect
  • About Unity
    • About Us
    • Blog
    • Events
    • Careers
    • Contact
    • Press
    • Partners
    • Affiliates
    • Security
Copyright © 2020 Unity Technologies
  • Legal
  • Privacy Policy
  • Cookies
  • Do Not Sell My Personal Information
  • Cookies Settings
"Unity", Unity logos, and other Unity trademarks are trademarks or registered trademarks of Unity Technologies or its affiliates in the U.S. and elsewhere (more info here). Other names or brands are trademarks of their respective owners.
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Default
  • Help Room
  • META
  • Moderators
  • Explore
  • Topics
  • Questions
  • Users
  • Badges