Can we use the territory feature in the contacts module?
No, the territory feature can only be used in two ways
1) Assign records to owners on a round-robin basis
2) Give access to a set of users who will be able to view the records.
Both these features can be used in the leads module as the records assignment can only be used in the leads module.