what does "inner_packed_states_array" mean?

[HalFTeen]

I have seen the explanation: "inner states need to be record, type: tuple". Are there any other role except for recording the innner states？ Because I found it can still get the correct result without the parameter. looking forword to your reply. THX.

[godjealous]

The structure "inner_packed_states_array" is an interface for future expand.

Now, for Transformer model, this structure could be ignored because every token records full history labels. So, you could get correct results without the parameters.

However for other End-to-End models, for example LAS, it is useful to record some Intermediate state to avoid Repeated calculation