I believe (so don't take it as fact), if your turn signal is on and they're behind you, you have the right of way. IF they edge forward to the line (as many do, which I think is legal?) and are to your front-right you should wait.

Again, driving and biking laws get muddled so it's hard to tell.