A screamer from Jake Duffy put the home side in front while Rugby lost Jackson to a red card four minutes before half time.