I won't say you should be penalized for it, but I will say it will not benefit you when compared to other teams with similar records. It's not your fault the SEC gave you an easy schedule. But, if you have an easy schedule you better win the games or it will be held against you in comparisons. You've only lost one game. Win the rest and it won't matter. Lose another and now you have a problem - lose to Arky and that's a bad loss and a good loss, with one good win. Lose to ATM, and you have 2 good losses with no good wins. Either way, that won't look good compared to other 2 loss teams who have better wins.
Next year you will get the benefit of playing tOSU, and then you play @UGA. If you lose both, you will be in trouble with few if any good wins unless some of those SEC teams are better.
Look I was glad to get TX and OU, I love the divisionless football, and I hope at some point we go to 9 IC games. But the SEC simply has to do a better job scheduling. It's absurd to have such a disparity between teams like you guys and then UF and OU. That simply should not have happened.