With all due respect, it sounds like you're being a tad hypocritical. You're contradicting yourself.
You say that a name such as Riley shouldn't be turned into a unisex name, because it's originally a boy's. But, then, you say Morgan is more girly. The same that happened to Morgan is happening to Riley right now. Morgan was originally a boy's name (and is still used on boys, such as Morgan Freeman, and my friend's little brother is named Morgan) that unfortunately started getting slapped onto girls, just like Riley is. Morgan's not as girly as everyone thinks it is. I, personally, adore it on a boy and would use it on my son in a heartbeat.
Technically, there are no "unisex" names. All names started off on strictly one gender, and eventually, parents started to be daring and used it on the opposite sex. Nameberry.com is a good example of this. None of their names are listed as unisex; they have them listed under whatever gender they originally were. Ashley and Kelly were very strong boy names not too long ago, but are now considered "feminine" simply because people starting sticking them on their daughters. It's very sad, but I wouldn't be surprised to see names like Dylan, Ryan, Taylor and Cameron become all girl names within the next ten years. It's pretty ridiculous, but it's happened with tons of boy names.
To get to the point, it really just comes down to opinion. Some people believe that ANY name that was originally a boy's should still be very masculine and male only (even names like Meredith and Joyce.) Others are into the trendy style, where boy names are cute on girls, even names like Tyler and Hunter. I suppose no one's really right or wrong, because you can name your child any name that you like, and it'll be on you with whether or not they get made fun of or if they like their name or not.
Me? I'm somewhere in between, but I lean more towards the side of a boy's name should always be a boy's name. I love names like Morgan, Bailey, Avery, Casey, Ashton and Shannon for boy's, even if they are popular for girls. They were originally very masculine, so I don't see why they still shouldn't be.