What does “のごく” mean?

Here’s an example phrase from an already-translated VN using it:

だが、古手神社の境内の中で一二を争うほどの神聖な場所で、中に入れる人間は古手本家の人間と、御三家の**ごく**限られた一部の人間だけに限定されている。

Only people from the Furude family and selected members of the other two Three Families are allowed to enter.

I assume in this context it means “simply” or “only” people from the Three Families, but I would like more clarification.