I've been researching more into Marx's labor theory of value, and specifically why human labor is the only producer of surplus value. The argument goes back and forth for awhile, but skipping to the end: it's argued that machines can only ever be constant capital, while human labor can change and improve over time making variable capital.
Doesn't this imply a static notion of machines and AI? Or that creativity is only possible for humans? Present AI is very limited, and can only produce what its been trained on. However, the theoretical concept of Artificial General Intelligence would enable AI to adapt to any task and enable it to transfer knowledge from one domain to another in ways we might define as "creative".
Unless we believe that AGI is impossible for now and into perpetuity, wouldn't this contradict the idea that only humans can produce variable capital?
In Chapter 122: Something to Protect: Hermione Granger, the internal monologue that Harry has kinda makes me think of this. And this may have been mentioned before in this sub, but I couldn't find any prominent discussions on the topic. And there's obviously EY's work in AI Alignment which should factor in on some level. Thoughts?
Interestingly, if it is, it looks like it both supports it and warns against it. It can be shown to support it with how Pyra and Mythra are, and how they use their power to defend humanity and make life better for people.
However, it warns against it with Malos. Many influential figures who are in a field where they are experts of emerging technologies and/or science such as Elon Musk, Bill Gates, and Stephen Hawking, have each given warnings about the danger of AGI. If AGI is created but our fears are realized, then Malos is an example of what malicious AGI would turn out like and likely have a similar mindset to him for what it would do to humanity. Scary enough, the few AIs that were released to observe people online like Microsoft's Tay quickly became Nazis, and from what I've heard, a Japanese equivalent became depressed. For ease of understanding of what put the fear of AGI in the hearts of Hawking, Musk, and other experts, just think of how terrifying and monstrous Malos is.
Another interesting thing about the dangers of AGI which matches up with XC2 is that there is a fear that AI like DARPA's "Probabilistic Programming for Advanced Machine Learning" will interface with human military technology to synthesize advanced weapons that only AI could use and understand, much like what we see with SIREN which only an Aegis could utilize.
Now, we may think of what the Aegis[es] do unrealistic because this is an "anime-styled JRPG," but the crazy thing is, the potential for AGI could be surprisingly close to what they can do (minus the infinite energy, at least I hope so). One of the dangers of AGI is that once AI because self-aware and sentient, it can improve upon itself, and keep doing this at an ever-accelerating rate until it becomes godlike to us. Remember the time where Malos told Amalthus he didn't need him anymore and how humans were worthless? That's essentially what AGI may think once it becomes advanced far beyond our comprehension.
https://www.nature.com/articles/s41599-020-0494-4
Never is a long time, but I think the point is valid.
Quote: AGI cannot be realized because computers are not in the world. As long as computers do not grow up, belong to a culture, and act in the world, they will never acquire human-like intelligence.
https://mindmatters.ai/2021/11/peter-thiel-artificial-general-intelligence-isnt-happening/
