ESP32-S2-Kaluga-1 v1.2 + ESP-LyraT-8311a v1.2 - Doesn't work

[gonzoveliki]

1. It can't compile because ESP32-S2-Wrover module which is used on the Kaluga-1 v1. 2 board doesn't have two I2S, and compilation breaks at line 150 in audiokit_board.h
2. I've commented out lines 150-155, now it compiles ok, it talks via i2c on pins 7 and 8 with the codec 8311 successfully, but there is no sound from the generator output example.
3. PA_Enable is on pin10, it is enabled with kit.setSpeakerActive(true);

[pschatzmann]

Since I don't have any of this board, I can't really test.
I found that the i2s masterclock was mapped to 0 instead of 35.
If my correction is still not working, I suggest that you double check the mapping of all pins...

[gonzoveliki]

Thank you for your quick reply, indeed MCLK must be 35, and now I have sinewave audio output, but it is skipping and sounds distorted... it seems like an I2S fifo's buffer overrun... I'm digging on it now, I will report when I catch where it comes from. Then I will do full tests with microphone input as well. Best Regards

[gonzoveliki]

If I override default config's sample rate with
"cfg.sample_rate = AUDIO_HAL_08K_SAMPLES;"
just before
"kit.begin(cfg);"
SineWaveGenerator tests sounds normal.
With any other possible sample rate value it does skip and click noisily.
.....
I've tested input->output too... it doesn't catch any sound from microphone, but there is something like breathing white noise, goes up and down like an AGC is pumping... I will dump all registers and check thoroughly the configuration of ADC side...

[pschatzmann]

Did you change the log level ? This would explain the reduced sample rate.
Not sure which setting is the microphone: did you try both cfg.adc_input = AUDIO_HAL_ADC_INPUT_LINE2 and cfg.adc_input = AUDIO_HAL_ADC_INPUT_LINE1

[gonzoveliki]

Info: bool audiokit::AudioKit::begin(audiokit::AudioKitConfig)
Info: Selected board: 4
Info: i2c_sda 8, i2c_scl: 7
Info: SPI: cs: 13
Info: clk: 14, miso: 2, mosi: 15
Info: headphone detection not supported
Debug: audio_hal_init
Debug: audio_calloc: 1 * 36
Info: i2c port: 0
Info: i2c sda: 8
Info: i2c scl: 7
Debug: void* i2c_bus_create(i2c_port_t, i2c_config_t*)
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=1 value=48
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=2 value=0
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=3 value=16
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=22 value=36
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=4 value=16
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=5 value=0
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=11 value=0
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=12 value=0
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=16 value=31
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=17 value=127
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=0 value=128
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=0
Info: ES8311 in Slave mode
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=2 value=0
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=5
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=5 value=0
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=3
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=3 value=16
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=4
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=4 value=16
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=7
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=7 value=0
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=8
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=8 value=255
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=6
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=6 value=3
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=1
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=1 value=63
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=6
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=6 value=3
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=19 value=16
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=27 value=10
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=28 value=106
Debug: audio_codec_initialize -> 0
Info: audio_codec_initialize-END-OK
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=9
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=10
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=9 value=12
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=10 value=12
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=9
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=10
Debug: ES8311 in I2S Format
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=9 value=12
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=10 value=12
Debug: SET: volume:51
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=50 value=51
Debug: setupI2S
Info: i2s bck_io_num: 18
Info: i2s ws_io_num: 17
Info: i2s data_out_num: 12
Info: i2s data_in_num: 46
Info: i2s_set_pin
Info: - bck_io_num: 18
Info: - ws_io_num: 17
Info: - data_out_num: 12
Info: - data_in_num: 46
Info: - mck_io_num: 35
Debug: audio_hal_ctrl_codec
Info: Codec mode is 3, Ctrl:1
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=9
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=10
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=9 value=12
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=10 value=12
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=23 value=191
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=14 value=2
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=18 value=0
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=20 value=26
Debug: i2c_bus_read_bytes: addr=48 reglen=1 datalen=1 - reg=20
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=20 value=26
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=13 value=1
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=21 value=64
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=55 value=72
Debug: i2c_bus_write_bytes: addr=48 reglen=1 datalen=1 - reg=69 value=0
.....
Debug: read: 1024
Debug: write: 1024
Debug: read: 1024
Debug: write: 1024
.....

[gonzoveliki]

Yes, I did..same results, ADC reads samples full of harsh white noise, pumping up and down... Today I will dig deeper with an oscilloscope and Logic Analyzer to check I2S integrity. As I was able to trace the code flow of initialization all I2C registers were loaded properly as intended. I will make the same log for a LyraT v4.3 board which is working normally, to see are there some skipped sections of the init sequence.

[pschatzmann]

I think the mic is connected as diff input: did you try cfg.adc_input =AUDIO_HAL_ADC_INPUT_DIFFERENCE

[gonzoveliki]

I did try with LINE1 and LINE2, now with DIFFERENCE... it's the same pumping noise up and down, but now i think there is a "difference" - the microphone is picking at least something, because when the noise is going down, I can hear something - if knock on the board or whistling straight into the mic. It looks that it comes from some kind of Auto Leveling Gain control which is out of lock.

[gonzoveliki]

[gonzoveliki]

This codec supports digital mics too (Digital Data goes like single ended mic into the chip, while mic's clock is sourced from I2S)
Both for analog and digital mics it offers some basic DSP's gain, filtering and equalizer features on-board. I will fiddle with corresponding registers so hear is there any change.

[pschatzmann]

Not sure if this helps, but I wondered about the following line:
#define ES8311_MCLK_SOURCE 1 /* 0 From MCLK, 1 From BCLK */
I would have expected this to be 0 ...

[gonzoveliki]

I've tested that already and it didn't help, but I'm about to nail it. There is ALC control which needs to be constrained in gain, and there is muting threshold levels to suppress background noise in idle.. These registers don't have proper factory defaults, so I fiddled randomly with values, and now it is recoding clean an undistorted audio. I will test thoroughly to see which are vital for proper initialization for recording, so you can add some extra functionality to HAL and the codec chip driver. I think some conditional #ifdefs must be used as well, so the problem with missing I2S_NUM1 on S2-Wrover modules shall be sorted. I will make a full report of other tests and will give you necessary stuff you wish to change the code base. Best regards

[gonzoveliki]

I'm still chasing the sampleRate issue, it is working good only with 8k. On all other possible rates it does skipping and clicking but sound pitch is unchanged - so it's not like sampling frequency mismatch, but more like I2S buffer overrun. Now I will connect the codec board LyraT to another MCU which is not S2, but WROVER-E, to check the possibility that bug comes from ESP core libs.

[gonzoveliki]

Higher samplerates than 8k, consumes buffer qiucker, so if i increase buffer to 16000, and use 16k as sample rate, it sounds 1/2 of the time, if i make buffer 32k and sample rate also 32k, it sounds 1/4 of the second... I thought it is related with that this codec is mono, and SineGenerator feeds two 16bit integers for a sample into the buffer... but it is not that... I will dig more, so far I achieved good recording/playback audio @8k samplerate, after settled mic gain and ALC min/max levels...

[pschatzmann]

Maybe it helps to compare the actual 8311.c from ADF with my (old) copy. I noticed that the coeff_div has changed.