I think this topic came up before and I (I also believe KWRBT) explained it.
What that Rabbi told you doesn't make sense. It is either meat or it is not meat, thus all the rules apply or they do not. Cannot consider it meat (thus Kashrut apply) AND then consider it as non-meat when it is applied to dairy.