An alternative is we are among the first. Third generation stars are the ones that have planets with enough heavy elements to allow for complex chemistry. Sol (our star) is thought to be among the first batch of third generation stars in our gallexy.
Light speed does seem to be the upper speed limit for the universe. Talking that into account we probably haven't had a chance to see other early life as it would likely be spread pretty thin right now.