Revert "net: sched: cls: Fix offloading when ingress dev is vxlan"

This reverts commit d96a43c6.

This potentially breaks things, so reverting as per
request by Jakub Kicinski.

Signed-off-by: David S. Miller <davem@davemloft.net>