jit.fprint precision

Mar 29, 2012 at 9:22pm

jit.fprint precision

Hi

I’m reading in a matrix from a text file using jit.fprint. The matrix contains fractions with six digits after the decimal point. Unfortunately no matter what I do when the matrix comes out of jit.fprint it only has 3 digits after the decimal point. I’ve tried setting jit.fprint with @precision 6 and I’ve tried having it output a float64 matrix but nothing works. What’s going on?

#62662
Mar 29, 2012 at 9:27pm

Never mind – I forgot to set the @precision attribute of jit.print

#226331

You must be logged in to reply to this topic.