|
|
Atari coding BBS
| Re: DSP frac arithmetic help |
|---|
|
Posted by: Splash/S1
|
Feb,27.2015-20:21
|
0xFF800000 is -1. You take the absolute value which is +1. But +1 cannot be represented, only 0.9999999 can be represented: you have an overflow, and some of your DSP flags should reflect this. ABS just do 0-value. if in hex you do 0-ff800000 you get 00800000.
Consider the DSP only knows values from -0.999999 to 0.999999 natively.
|
[All messages in this thread] [Start new thread]
|
Topic
|
Posted by
|
Date
|
|
DSP frac arithmetic help
|
Laurent / Thadoss
|
Feb,27.2015-15:03
|
|
Re: DSP frac arithmetic help
|
Laurent / Thadoss
|
Feb,27.2015-15:08
|
|
Re: DSP frac arithmetic help
|
dml
|
Feb,27.2015-15:28
|
|
Re: DSP frac arithmetic help
|
Laurent / Thadoss
|
Feb,27.2015-18:32
|
|
Re: DSP frac arithmetic help
|
dml
|
Feb,27.2015-18:42
|
|
Re: DSP frac arithmetic help
|
dml
|
Feb,27.2015-18:46
|
|
Re: DSP frac arithmetic help
|
Splash/S1
|
Feb,27.2015-20:21
|
|
Re: DSP frac arithmetic help
|
dml
|
Feb,27.2015-20:38
|
|
Re: DSP frac arithmetic help
|
Laurent / Thadoss
|
Feb,27.2015-20:42
|
|
Re: DSP frac arithmetic help
|
mikro
|
Feb,28.2015-10:44
|
|
Re: DSP frac arithmetic help
|
dml
|
Feb,28.2015-12:35
|
What's the anti-troll code?
That's your personal code to be able to add comments and messages on the dhs.nu site.
Don't have a code or forgot it? Fix it here.
|
