Most people’s citizenship is involuntary – it was determined by where they were born – so they are subject to governance which they haven’t agreed to. This appears to breach the minimum constraints on the natural liberty of the individual, as defined by John Stuart Mill in what is often referred to as the ‘Harm Principle’:
“the only purpose for which power can be rightfully exercised over any member of a civilized community, against his will, is to prevent harm to others.” 
A key area of contention in this statement is the expression “against his will”. The individualist argument is that those who want governance that is more extensive than a “minimal State” (6.2.2) could only have this by imposing their will on other people – a “philosophy of violence and coercion”, as Milton Friedman expressed it (220.127.116.11). Rousseau, though, argued that people do not lose their freedom by contracting with others because:
“Each of us puts his person and all his power in common under the supreme direction of the general will, and, in our corporate capacity, we receive each member as an indivisible part of the whole.” 
The concept of negotiability, as described in this book, contains some of the elements of Rousseau’s concept – we are collectively the masters of those aspects of governance which are negotiable (6.8.4) – but Rousseau failed to acknowledge the need to restrict the scope of governance and the need for checks and balances to avoid the oppression of minorities.
An individual’s freedom is constrained by any governance framework, irrespective of how it was constructed and how popular it is. Society requires governance in the Economic, Legal, Moral and Political Dimensions of Power – and also commits people to participate in State use of Ungoverned Power. It is important that governance is more of a support to freedom than a threat to it, so its scope should be no wider than is necessary to ensure that everyone has both ‘positive’ freedom – which here is taken to mean having the ‘capability’ to make desired choices – and ‘negative’ freedom: the absence of constraints other than the requirement to grant similar freedom to other people. As Karl Popper wrote:
“I demand protection for my own freedom and for other people’s….
I demand that the fundamental purpose of the state should not be lost sight of ; I mean, the protection of that freedom which does not harm other citizens. Thus I demand that the state must limit the freedom of the citizens as equally as possible, and not beyond necessity.” 
There is an important principle stated here in the last three words: “not beyond necessity”. Given that almost all power relationships have required someone to concede at least part of their wishes, the scope of governance should not infringe on people’s liberty beyond what is necessary to protect other people – recognising that this scope is itself fiercely contested.
 Jean-Jacques Rousseau, The Social Contract or Principles of Political Right, Book I, Chap. 6, penultimate paragraph. It was available in April 2018 at http://etext.lib.virginia.edu/toc/modeng/public/RouSoci.html.
 Karl Popper, The Open Society and its Enemies, Chap. 6, p. 96. This was available in April 2018 at https://archive.org/details/FullTextOfTheOpenSocietyAndItsEnemiesVolI.