Settings such as patient lists are set on a tab by tab basis. So you will need to choose a patient list for each tab you are using e.g. Referrals, Contacts etc.
From the relevant tab within Task List:
Right click on ‘Assigned Tasks‘ (towards top left).
Click ‘Customise Patient View‘.
In the Task List Properties pop-up window, put a tick in the box for ‘Choose a Patient List’.