Wayback Machinekoobas.hobune.stream
May JUN Jul
Previous capture 12 Next capture
2021 2022 2023
1 capture
12 Jun 22 - 12 Jun 22
sparklines
Close Help
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
  • Asset Store
  • Get Unity

UNITY ACCOUNT

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account
  • Blog
  • Forums
  • Answers
  • Evangelists
  • User Groups
  • Beta Program
  • Advisory Panel

Navigation

  • Home
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
    • Blog
    • Forums
    • Answers
    • Evangelists
    • User Groups
    • Beta Program
    • Advisory Panel

Unity account

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account

Language

  • Chinese
  • Spanish
  • Japanese
  • Korean
  • Portuguese
  • Ask a question
  • Spaces
    • Default
    • Help Room
    • META
    • Moderators
    • Topics
    • Questions
    • Users
    • Badges
  • Home /
avatar image
0
Question by GuntranHoet · Dec 17, 2015 at 10:25 AM · imageraycastingstenciladvancedexperience

Get object from scene (world space) from a grayscale saliency image (screen space)

I'm developing a salience tool inside Unity3D. My aim is to highlight an object model in the scene when it is the most salient in the player's view, not real-time.

What I have in mind now it to move the camera around in the scene and have it take screenshots on a interval. After this 'recording' is done. I run an external program that generates a salience map of the screenshots (a grayscale texture where white means very attention grabbing).

Now I want to replay my recording in Unity3D, but instead of taking a screenshot at each position, I place the salience image "on top of the camera's view" and want to get the object(s) that are located behind the white spot(s).

An example:
The original screenshot: alt text

Would result into an salience image like this... alt text

I would want to 'project' this grayscale image onto my scene from the camera's view and get the object(s) behind the most white places. Here it would be: The Waterfall, The lantern, The house by the lantern.

I heard this might be possible by use of Stencil Buffers, but I have no idea if that's true. Could somebody confirm that? Or give other solutions? All help is welcome :)

PS: just thought of a new (possible) solution, maybe i could do a raycast from every pixel in screen space that has a high value (240+) (thus white) to world space and get the hit result. Maybe this is a easier solution? I don't know much about Stencil Buffers, so maybe that's still the best route (?), but i would like to explore that subject :)

tombraider.jpg (122.3 kB)
tombraider-0-saliency.png (23.2 kB)
Comment
Add comment
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

0 Replies

· Add your reply
  • Sort: 

Your answer

Hint: You can notify a user about this post by typing @username

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this Question

Answers Answers and Comments

30 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Possible to use sprite mesh for UI.Image GraphicRaycaster culling? 1 Answer

Finding a pixel in an images texture by raycast 0 Answers

How to get solve two or more UI images alphas? 0 Answers

Touch count & Raycasting on mobile 0 Answers

Grid Pathfinding 0 Answers


Enterprise
Social Q&A

Social
Subscribe on YouTube social-youtube Follow on LinkedIn social-linkedin Follow on Twitter social-twitter Follow on Facebook social-facebook Follow on Instagram social-instagram

Footer

  • Purchase
    • Products
    • Subscription
    • Asset Store
    • Unity Gear
    • Resellers
  • Education
    • Students
    • Educators
    • Certification
    • Learn
    • Center of Excellence
  • Download
    • Unity
    • Beta Program
  • Unity Labs
    • Labs
    • Publications
  • Resources
    • Learn platform
    • Community
    • Documentation
    • Unity QA
    • FAQ
    • Services Status
    • Connect
  • About Unity
    • About Us
    • Blog
    • Events
    • Careers
    • Contact
    • Press
    • Partners
    • Affiliates
    • Security
Copyright © 2020 Unity Technologies
  • Legal
  • Privacy Policy
  • Cookies
  • Do Not Sell My Personal Information
  • Cookies Settings
"Unity", Unity logos, and other Unity trademarks are trademarks or registered trademarks of Unity Technologies or its affiliates in the U.S. and elsewhere (more info here). Other names or brands are trademarks of their respective owners.
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Default
  • Help Room
  • META
  • Moderators
  • Explore
  • Topics
  • Questions
  • Users
  • Badges