Thinking about this some more, I remember @budparr documenting different summary behavior depending on how the summary content was specified.
See Inconsistent behavior with .Summary tag
Then try specifying your summary with the more syntax:
<!--more-->