Source notes impact compilation results as evident by -dannot-lint failures when running GHC testsuite

Passing -dannot-lint to the testsuite highlights quite a few tests which fail the check.

If I run with

+TEST_HC_OPTS += -dannot-lint
+TEST_HC_OPTS += -finfo-table-map

then I get a few more failures

"T11068 T13367 T13585 T15155 T15155l T15970 T17901 T3736 T4003 T5658b T5996 cg010 determ017 determ018 str-rules"

Test log: https://gist.github.com/b7df0ef343f4e856eb4eda4bf0eebc04

Also running -dannot-lint on GHC itself fails, likewise for Cabal. Really we claim that source notes don't affect the optimiser so the lint pass should work fine.

Perhaps something for @AndreasK, the tick master.