Wayback Machinekoobas.hobune.stream
May JUN Jul
Previous capture 13 Next capture
2021 2022 2023
1 capture
13 Jun 22 - 13 Jun 22
sparklines
Close Help
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
  • Asset Store
  • Get Unity

UNITY ACCOUNT

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account
  • Blog
  • Forums
  • Answers
  • Evangelists
  • User Groups
  • Beta Program
  • Advisory Panel

Navigation

  • Home
  • Products
  • Solutions
  • Made with Unity
  • Learning
  • Support & Services
  • Community
    • Blog
    • Forums
    • Answers
    • Evangelists
    • User Groups
    • Beta Program
    • Advisory Panel

Unity account

You need a Unity Account to shop in the Online and Asset Stores, participate in the Unity Community and manage your license portfolio. Login Create account

Language

  • Chinese
  • Spanish
  • Japanese
  • Korean
  • Portuguese
  • Ask a question
  • Spaces
    • Default
    • Help Room
    • META
    • Moderators
    • Topics
    • Questions
    • Users
    • Badges
  • Home /
avatar image
0
Question by Digital-Dreams · Nov 27, 2013 at 06:41 PM · microphonepitchfrequency

Microphone pitch/dB analysis

I'm looking into analyzing microphone input. For this I want to see what the dB and (voice's) pitch/frequence is. I think I'm getting the dB info properly using GetOutputData(). I know I'm supposed to use GetSpectrumData() for the pitch, but I can't find any examples online on this subject (other than a seemingly broken one http://answers.unity3d.com/questions/275378/simple-lipsync-with-microphone-input.html, why the FreqN index is used, is beyond me).

The question would be: How do I manipulate the float[] data into meaningful Hz information?

This code is work in progress, so it's rambling on several sides, but it's mostly that weird linked thing, which does yield some believable values sometimes.. but why, I don't know:

 private void AnalyzeSound() 
 {
 
     // Get all of our samples from the mic.
     audio.GetOutputData(samples, 0);
      
     // Sums squared samples
     float sum = 0;
     for (int i = 0; i < SAMPLECOUNT; i++)
     {
         sum += samples[i] * samples[i];
     }
      
     // RMS is the square root of the average value of the samples.
     if (sum == 0 )
     {
         rmsValue = 0f;
         dbValuePrev = dbValue;
         dbValue = 0f;
         pitchValuePrev = pitchValue;
         pitchValue = 0f;
         return;
     }
     rmsValue = Mathf.Sqrt(sum / SAMPLECOUNT);
     dbValue = 20 * Mathf.Log10(rmsValue / REFVALUE);
      
     // Clamp it to {clamp} min
     if (dbValue < -clamp) 
     {
         dbValue = -clamp;
     }
      
     // Gets the sound spectrum.
     audio.GetSpectrumData(spectrum, 0, fftWindow);
     float maxV = 0;
     int maxN = 0;
 
     // Find the highest sample.
     for (int i = 0; i < SAMPLECOUNT; i++)
     {
         if (spectrum[i] > maxV && spectrum[i] > THRESHOLD)
         {
             maxV = spectrum[i];
             maxN = i; // maxN is the index of maxV
         }
     }
      
     // Pass the index to a float variable
     float freqN = maxN;
 
     // Interpolate index using neighbours
     if (maxN > 0 && maxN < SAMPLECOUNT - 1) 
     {
         float dL = spectrum[maxN-1] / spectrum[maxN];
         float dR = spectrum[maxN+1] / spectrum[maxN];
         freqN += 0.5f * (dR * dR - dL * dL);
     }
 
     // Convert index to frequency
     pitchValue = freqN * 24000f / (float)SAMPLECOUNT ;
 
     // Internal pitch/dB value stuff        
 
     dbValuePrev = dbValue;
     pitchValuePrev = pitchValue;
 }
Comment
Add comment
10 |3000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

0 Replies

· Add your reply
  • Sort: 

Your answer

Hint: You can notify a user about this post by typing @username

Up to 2 attachments (including images) can be used with a maximum of 524.3 kB each and 1.0 MB total.

Follow this Question

Answers Answers and Comments

17 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

How do I get the fundamental frequency pitch for audio input? 0 Answers

Get the frequency from an AudioSource 1 Answer

Is it possible to listen microphone in frequency range? 0 Answers

How to Change the frequency of an audioClip? 1 Answer

How does AudioSource.pitch changes pitch? 1 Answer


Enterprise
Social Q&A

Social
Subscribe on YouTube social-youtube Follow on LinkedIn social-linkedin Follow on Twitter social-twitter Follow on Facebook social-facebook Follow on Instagram social-instagram

Footer

  • Purchase
    • Products
    • Subscription
    • Asset Store
    • Unity Gear
    • Resellers
  • Education
    • Students
    • Educators
    • Certification
    • Learn
    • Center of Excellence
  • Download
    • Unity
    • Beta Program
  • Unity Labs
    • Labs
    • Publications
  • Resources
    • Learn platform
    • Community
    • Documentation
    • Unity QA
    • FAQ
    • Services Status
    • Connect
  • About Unity
    • About Us
    • Blog
    • Events
    • Careers
    • Contact
    • Press
    • Partners
    • Affiliates
    • Security
Copyright © 2020 Unity Technologies
  • Legal
  • Privacy Policy
  • Cookies
  • Do Not Sell My Personal Information
  • Cookies Settings
"Unity", Unity logos, and other Unity trademarks are trademarks or registered trademarks of Unity Technologies or its affiliates in the U.S. and elsewhere (more info here). Other names or brands are trademarks of their respective owners.
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Default
  • Help Room
  • META
  • Moderators
  • Explore
  • Topics
  • Questions
  • Users
  • Badges