Measurement and 3D imaging of acoustic waves through the acousto-optic effect has recently been demonstrated by means of Optical Feedback Interferometry (OFI). In this paper we study experimentally the lower limits of detection of an acoustic wave using an OFI sensor. We show that the OFI sensor exhibits a linear response to acoustic power variations, and we obtain a lower limit of detection of 83 dB rms for a planar acoustic wave at 3 kHz. We also determine the equivalent displacement, that is seen by the OFI sensor at this pressure level, to be 96 pm. A deeper understanding of the limits of the technology and the quantification of the acousto-optic effect shall help improve the applications already created for the measurement of acoustic pressure waves using OFI.