Just add an extra filter for the "To-do list":

"In Folder" is exactly "Tasks"

Then the task views you created will be applied to only the items in the task list and the rest (flagged items) are filtered away.

This way it doesnt matter if you are using the Task list or the "To-do list"...

/OIV