Novak sank 5 of 7 from three-point shots and 7 of 10 shots overall, playing a career high 40-minutes.
The Bucks (7-6) were coming off a come-from-behind win over the Bulls in Chicago, coming from 27-points down in the second half. But there would be no comebacks this time against the Knicks.
Carmelo Anthony scored 29 points and pulled down 8 rebounds in 30 minutes of work for the Knicks.
Brandon Jennings and Beno Udrih each scored 18 points in the loss for the Bucks.
The Bucks next face the Timberwolves in Minnesota on Friday night.