Do you think I should drop my TE for RB?

I don't think it is a bad idea to have more depth and choices in a category. Plus, Olsen is a good enough starter that the only time you would need Scheffler would be if Olsen gets hurt or during his bye week. The only problem is you will need a different TE at least one week out of the year, but I am sure you can pick one up somewhere.