Knowing what we know about Rosebud...
... makes the ending much more sordid (..and believable if what followed in the 50yrs is any indication).
So we are left knowing what it is he is truly sorry about leaving behind and it's not something so innocent as a boyhood sled.