I have a custom protocol, consisting of messages. In the beginning of connection there is a security negotiation process, when the peers send each other a message with security options. After that, the peers either continue to communicate unsecured, sending messages over TCP, or perform TLS handshake and then continue sending messages over the established SSL channel. The communication stays on the same connection, i.e. does not switch to another port for secured part.
I have written a Lua dissector for the protocol with my_proto.dissector(tvbuf, pktinfo, root) which assumes unencrypted data. The only mention of TLS/SSL in the dissector code is registering the dissector in DissectorTable.get("ssl.port") in addition to DissectorTable.get("tcp.port").
Now the problem is when I try to dissect communication, which negotiates to TLS at the beginning. For the secured part of communication the dissector works fine, but the first unsecured messages are shown as protocol TLSv1.2 with Ignored Unknown Record instead of my protocol, and I cannot get it to be decoded by my dissector, Decode As... does not help. The only way to see those first unsecured messages dissected by my dissector is to completely turn off TLS protocol in Analyse -> Enabled Protocols... menu. But then I obviously won't see the secured part of communication.
Is there a way to see both secured and unsecured communication dissected at the same time?
To descrypt TLS part I use SSLKEYLOGFILE file, if that matters.
