Software:Midjourney

From HandWiki
Short description: Image-generating machine learning model
Midjourney
Logo
Logo
Developer(s)Midjourney, Inc.
Initial releaseJuly 12, 2022; 21 months ago (2022-07-12) (open beta)
Websitemidjourney.com
Artificial intelligence
Major goals
Approaches
Philosophy
History
Technology
Glossary

Midjourney is a generative artificial intelligence program and service created and hosted by San Francisco –based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion.[1][2] It is one of the technologies of the AI Spring.

The tool is currently in open beta, which it entered on July 12, 2022.[3] The Midjourney team is led by David Holz, who co-founded Leap Motion.[4] Holz told The Register in August 2022 that the company was already profitable.[5] Users create artwork with Midjourney using Discord bot commands.[6]

History

Midjourney, Inc. was founded in San Francisco , by David Holz,[7] previously co-founder of Leap Motion.[8] The Midjourney image generation platform first entered open beta on July 12, 2022.[3] On March 14, 2022, the Discord server launched with a request to post high-quality photographs to Twitter/Reddit for system's training.[citation needed]

Model versions

The company has been working on improving its algorithms, releasing new model versions every few months. Version 2 of their algorithm was launched in April 2022[9] and version 3 on July 25.[10] On November 5, 2022, the alpha iteration of version 4 was released to users.[11][12] On March 15, 2023, the alpha iteration of version 5 was released.[13] The 5.1 model is more opinionated than version 5, applying more of its own stylization to images, while the 5.1 RAW model adds improvement while working better with more literal prompts. After version 5.2 is released with a increasingly better image quality.[citation needed] On December 21, 2023, the alpha iteration of version 6 was released. The model was trained from scratch over a nine month period. Support was added for better text rendition and a more literal interpretation of prompts.

Regular models
Version Release date
V1 February 2022[14]
V2 April 12, 2022[9]
V3 July 25, 2022[10]
V4 November 5, 2022 (alpha)[11]
V5 March 15, 2023 (alpha)[13]
V5.1 May 3, 2023[15]
V5.2 June 22, 2023[16]
V6 December 21, 2023 (alpha)[17]
Other models
Version Release date Notes
--beta August 22, 2022
test/testp August 28, 2022
Niji December 20, 2022 Collaboration between Midjourney and Spellbrush
tuned to produce anime and illustrative styles
Niji 5 April 2, 2023

Functionality

Midjourney is currently only accessible through a Discord bot on their official Discord server, by direct messaging the bot, or by inviting the bot to a third party server. To generate images, users use the /imagine command and type in a prompt;[18] the bot then returns a set of four images. Users may then choose which images they want to upscale. Midjourney is also working on a web interface.[citation needed]

Beyond the /imagine command, Midjourney offers many other commands to send to the Discord bot. Including but not limited to the /blend command which allows the user to blend two images, the /shorten command allowing the user to get suggestions on how to make a long prompt shorter, and others which improve upon the Midjourney experience.[citation needed]

Uses

Founder David Holz says he sees artists as customers, not competitors of Midjourney. Holz told The Register that artists use Midjourney for rapid prototyping of artistic concepts to show to clients before starting work themselves.[5] Some artists have accused Midjourney of devaluing original creative work by using it in the training set;[19] Midjourney's terms of service includes a DMCA takedown policy, allowing artists to request their work to be removed from the set if they believe copyright infringement to be evident.[20]

The advertising industry has been quick to embrace AI tools such as Midjourney, DALL-E, and Stable Diffusion, among others. The tools, which enable advertisers to create original content and brainstorm ideas quickly are providing new opportunities, such as "custom ads created for individuals, a new way to create special effects, or even making e-commerce advertising more efficient", according to Ad Age.[21]

Architects have described using the software to generate mood boards for the early stages of projects, as an alternative to searching Google Images.[22]

Notable usage and controversy

Théâtre D'opéra Spatial, a Midjourney image that won first prize in a digital art competition
Image from Alice and Sparkle, a children's book illustrated by Midjourney. Time (magazine) describes this image as "showing the limits of the AI-powered technology. The illustration has several apparent flaws, including the character appearing to have claws."[23]

The program was used by the British magazine The Economist to create the front cover for an issue in June 2022.[24][25] In Italy, the leading newspaper Corriere della Sera published a comic created with Midjourney by writer Vanni Santoni in August 2022.[26] Charlie Warzel used Midjourney to generate two images of Alex Jones for Warzel's newsletter in The Atlantic. The use of an AI-generated cover was criticised by people who felt it was taking jobs from artists. Warzel called his action a mistake in an article about his decision to use generated images.[27] Last Week Tonight with John Oliver included a 10-minute segment on Midjourney in an episode broadcast in August 2022.[28][29]

A Midjourney image called Théâtre D'opéra Spatial won first place in the digital art competition at the 2022 Colorado State Fair. Jason Allen, who wrote the prompt that led Midjourney to generate the image, printed the image onto a canvas and entered it into the competition using the name Jason M. Allen via Midjourney. Other digital artists were upset by the news.[19] Allen was unapologetic, insisting that he followed the competition's rules. The two category judges were unaware that Midjourney used AI to generate images, although they later said that had they known this, they would have awarded Allen the top prize anyway.[30]

In December 2022, Midjourney was used to create the images in an AI-generated children's book in the span of a weekend. Titled Alice and Sparkle, the book features a young girl who builds a robot that becomes self-aware. The creator, Ammaar Reeshi, spent hours tweaking Midjourney prompts, rejecting hundreds of generated results to ultimately choose 13 illustrations for the book.[31] Both the product and process drew criticism. One artist wrote that "the main problem... is that it was trained off of artists' work. It's our creations, our distinct styles that we created, that we did not consent to being used."[32]

A fake Midjourney-created image of Pope Francis wearing a puffer jacket, which went viral in 2023

In 2023, the realism of AI-based text-to-image generators, such as Midjourney, DALL-E, or Stable Diffusion,[33][34] reached such a high level that it led to a significant wave of viral AI-generated photos. Widespread attention was gained by a Midjourney-generated photo of Pope Francis wearing a white puffer coat,[35][36] the fictional arrest of Donald Trump,[37] and a hoax of an attack on the Pentagon,[38] as well as the usage in professional creative arts.[39][40]

Research has suggested that the images Midjourney generates can be biased. For example, even neutral prompts in one study returned unequal results on the aspects of gender, skin color, and location.[41] A study by researchers at the nonprofit group Center for Countering Digital Hate found the tool to be easy to generate racist and conspiratorial images.[42]

Content moderation and censorship in Midjourney

Prior to May 2023, Midjourney implemented a moderation mechanism predicated on a banned words system. This method prohibited the use of language associated with explicit content, such as sexual or pornographic themes, as well as extreme violence. Moreover, the system also banned certain individual words including religious and political figures, such as Allah or Xi Jinping. This practice occasionally stirred controversy due to perceived instances of censorship within the Midjourney platform.[43][44]

Commencing in May 2023, with subsequent updates post version 5, Midjourney transitioned to an AI-powered content moderation system. This advanced mechanism allowed for a more nuanced interpretation of user prompts by analyzing them in their entirety. It consequently facilitated the context-dependent use of words that had previously been prohibited. For instance, users can now prompt the AI to generate a portrait of Xi Jinping. At the same time, the system will prevent the generation of contentious images, such as depictions of global leaders, including Xi Jinping, in situations of arrest.[45]

Litigation

On January 13, 2023, three artists – Sarah Andersen, Kelly McKernan, and Karla Ortiz – filed a copyright infringement lawsuit against Stability AI, Midjourney, and DeviantArt, claiming that these companies have infringed the rights of millions of artists, by training AI tools on five billion images scraped from the web, without the consent of the original artists.[46]

The legal action was initiated in San Francisco by attorney Matthew Butterick in partnership with the Joseph Saveri Law Firm, the same team challenging Microsoft, GitHub, and OpenAI (developer of ChatGPT and DALL-E) in court. In July 2023, U.S. District Judge William Orrick inclined to dismiss most of the lawsuit filed by Andersen, McKernan, and Ortiz but allowed them to file a new complaint.[47]

Subscription service

Midjourney had three subscription tiers,[when?] which included a trial good for 25 image generations; the company withdrew it,[when?] citing high demand and misuse.[48] As of September 2023, Midjourney costs between $10 and $120 per month, depending on the plan.[49]

See also

References

  1. ↑ "Huge "foundation models" are turbo-charging AI progress". The Economist. https://www.economist.com/interactive/briefing/2022/06/11/huge-foundation-models-are-turbo-charging-ai-progress. 
  2. ↑ Hertzmann, Aaron (10 June 2022). "Give this AI a few words of description and it produces a stunning image – but is it art?" (in en). https://theconversation.com/give-this-ai-a-few-words-of-description-and-it-produces-a-stunning-image-but-is-it-art-184363. 
  3. ↑ 3.0 3.1 @midjourney (July 12, 2022). "We're officially moving to open-beta! Join now at discord.gg/midjourney. **Please read our directions carefully** or check out our detailed how-to guides here: midjourney.gitbook.io/docs. Most importantly, have fun!". https://twitter.com/midjourney/status/1547108864788553729. 
  4. ↑ Rose, Janus (July 18, 2022). "Inside Midjourney, The Generative Art AI That Rivals DALL-E". Vice. https://www.vice.com/en/article/wxn5wn/inside-midjourney-the-generative-art-ai-that-rivals-dall-e. 
  5. ↑ 5.0 5.1 Claburn, Thomas (August 1, 2022). "Holz, founder of AI art service Midjourney, on future images" (in en). The Register. https://www.theregister.com/2022/08/01/david_holz_midjourney/. 
  6. ↑ Hachman, Mark (July 26, 2022). "Midjourney's enthralling AI art generator goes live for everyone" (in en). PCWorld. https://www.pcworld.com/article/820518/midjourneys-ai-art-goes-live-for-everyone.html. 
  7. ↑ Salkowitz, Rob (2022-09-16). "Midjourney Founder David Holz On The Impact Of AI On Art, Imagination And The Creative Economy" (in en). https://www.forbes.com/sites/robsalkowitz/2022/09/16/midjourney-founder-david-holz-on-the-impact-of-ai-on-art-imagination-and-the-creative-economy/. 
  8. ↑ Vincent, James (2022-08-02). ""An engine for the imagination": an interview with David Holz, CEO of AI image generator Midjourney" (in en-US). https://www.theverge.com/2022/8/2/23287173/ai-image-generation-art-midjourney-multiverse-interview-david-holz. 
  9. ↑ 9.0 9.1 @midjourney (2022-04-18). "We recently started testing a V2 algorithm, it's much better with characters and animals". https://twitter.com/midjourney/status/1516138949219024898. 
  10. ↑ 10.0 10.1 @midjourney (2022-07-25). "Today we're starting to test our V3 image generation algorithms". https://twitter.com/midjourney/status/1551560891254001664. 
  11. ↑ 11.0 11.1 "David Holz on the official Midjourney Discord server". 2022-11-05. https://discord.com/channels/662267976984297473/952771221915840552/1038335529747480607. 
  12. ↑ "Midjourney v4 greatly improves the award-winning image creation AI" (in en-US). 10 November 2022. https://www.techspot.com/news/96619-midjourney-v4-greatly-improves-award-winning-image-creation.html. 
  13. ↑ 13.0 13.1 "Midjourney V5 Creates Better Images, Fewer Nightmare Hands" (in en-US). 16 March 2023. https://www.howtogeek.com/879711/midjourney-v5-creates-better-images-fewer-nightmare-hands/. 
  14. ↑ "Midjourney Model Versions" (in en). https://docs.midjourney.com/legacy/docs/models. 
  15. ↑ Collins, Barry (2023-05-03). "Midjourney 5.1 Arrives - And It's Another Leap Forward For AI Art" (in en). https://www.forbes.com/sites/barrycollins/2023/05/03/midjourney-51-arrivesand-its-another-leap-forward-for-ai-art/. 
  16. ↑ Edwards, Benj (23 June 2023). ""Stunning"—Midjourney update wows AI artists with camera-like feature" (in en-us). Ars Technica. https://arstechnica.com/information-technology/2023/06/stunning-midjourney-update-wows-ai-artists-with-camera-like-feature/. 
  17. ↑ Franzen, Carl (21 December 2023). "Midjourney V6 is here with in-image text and completely overhauled prompting". https://venturebeat.com/ai/midjourney-v6-is-here-with-in-image-text-and-completely-overhauled-prompting/. 
  18. ↑ Becker, Isaac Stanley; Harwell, Drew (March 30, 2023). "How a tiny company with few rules is making fake images go mainstream". The Washington Post. https://www.washingtonpost.com/technology/2023/03/30/midjourney-ai-image-generation-rules/. 
  19. ↑ 19.0 19.1 Gault, Matthew (August 31, 2022). "An AI-Generated Artwork Won First Place at a State Fair Fine Arts Competition, and Artists Are Pissed" (in en). Motherboard (Vice). https://www.vice.com/en/article/bvmvqm/an-ai-generated-artwork-won-first-place-at-a-state-fair-fine-arts-competition-and-artists-are-pissed. 
  20. ↑ "Terms of Service" (in en). https://docs.midjourney.com/docs/terms-of-service. 
  21. ↑ Bonilla, Brian (2022-09-22). "How ad agencies are using AI image generators—and how they could be used in the future" (in en). https://adage.com/article/agency-news/how-agencies-use-ai-image-generators-dalle-e-2-midjourney-and-stable-diffusion/2430126. 
  22. ↑ "The Architects Designing Surreal Worlds with AI" (in en). Bloomberg.com. 31 January 2023. https://www.bloomberg.com/news/features/2023-01-31/architects-embrace-ai-art-generator-midjourney. 
  23. ↑ "He Made A Children's Book Using AI. Artists Are Not Happy" (in en). Time. 2022-12-14. https://time.com/6240569/ai-childrens-book-alice-and-sparkle-artists-unhappy/. Retrieved 2023-08-19. 
  24. ↑ "How a computer designed this week's cover". The Economist. https://www.economist.com/news/2022/06/11/how-a-computer-designed-this-weeks-cover. 
  25. ↑ Liu, Gloria (21 June 2022). "DALL-E 2 Made Its First Magazine Cover". https://www.cosmopolitan.com/lifestyle/a40314356/dall-e-2-artificial-intelligence-cover/. 
  26. ↑ Bozzi, Ida (2022-08-26). "Su "La Lettura", Highsmith inedita e le città che mutano" (in it-IT). Corriere della Sera. https://www.corriere.it/la-lettura/22_agosto_26/su-la-lettura-highsmith-inedita-citta-europee-trasformazione-af21cf38-2522-11ed-9c55-2dc9b0266fc8.shtml. 
  27. ↑ "I Went Viral in the Bad Way" (in en). 2022-08-17. https://newsletters.theatlantic.com/galaxy-brain/62fc502abcbd490021afea1e/twitter-viral-outrage-ai-art/. 
  28. ↑ Gentile, Dan (August 16, 2022). "John Oliver is weirdly popular on this SF-based AI image app". SFGATE. https://www.sfgate.com/streaming/article/hbo-john-oliver-ai-midjourney-17374718.php. 
  29. ↑ Brathwaite, Lester Fabian (August 29, 2022). "John Oliver marries a cabbage in ceremony officiated by Steve Buscemi on 'Last Week Tonight'" (in en). EW.com. https://ew.com/tv/john-oliver-marries-cabbage-steve-buscemi/. 
  30. ↑ Roose, Kevin (September 2, 2022). "An A.I.-Generated Picture Won an Art Prize. Artists Aren't Happy.". The New York Times. https://www.nytimes.com/2022/09/02/technology/ai-artificial-intelligence-artists.html. 
  31. ↑ Stokel-Walker, Chris (13 December 2022). "A Tech Worker Is Selling A Children's Book He Made Using AI. Professional Illustrators Are Pissed.". https://www.buzzfeednews.com/article/chrisstokelwalker/tech-worker-ai-childrens-book-angers-illustrators. 
  32. ↑ Popli, Nic (14 December 2022). "He Used AI to Publish a Children's Book in a Weekend. Artists Are Not Happy About It". Time (magazine). https://time.com/6240569/ai-childrens-book-alice-and-sparkle-artists-unhappy/. Retrieved 19 December 2022. 
  33. ↑ Verma, Pranshu; Schaul, Kevin. "See why AI like ChatGPT has gotten so good, so fast" (in en). Washington Post. https://www.washingtonpost.com/business/interactive/2023/artificial-intelligence-tech-rapid-advances/. 
  34. ↑ "Will AI-generated images create a new crisis for fact-checkers? Experts are not so sure" (in en). 2023-04-11. https://reutersinstitute.politics.ox.ac.uk/news/will-ai-generated-images-create-new-crisis-fact-checkers-experts-are-not-so-sure. 
  35. ↑ Novak, Matt. "That Viral Image Of Pope Francis Wearing A White Puffer Coat Is Totally Fake" (in en). https://www.forbes.com/sites/mattnovak/2023/03/26/that-viral-image-of-pope-francis-wearing-a-white-puffer-coat-is-totally-fake/. 
  36. ↑ Stokel-Walker, Chris (2023-03-27). "We Spoke To The Guy Who Created The Viral AI Image Of The Pope That Fooled The World" (in en). https://www.buzzfeednews.com/article/chrisstokelwalker/pope-puffy-jacket-ai-midjourney-image-creator-interview. 
  37. ↑ "Trump shares deepfake photo of himself praying as AI images of arrest spread online" (in en). 2023-03-24. https://www.independent.co.uk/news/world/americas/us-politics/donald-trump-ai-praying-photo-b2307178.html. 
  38. ↑ Oremus, Will; Harwell, Drew; Armus, Teo (2023-05-22). "A tweet about a Pentagon explosion was fake. It still went viral." (in en-US). Washington Post. ISSN 0190-8286. https://www.washingtonpost.com/technology/2023/05/22/pentagon-explosion-ai-image-hoax/. 
  39. ↑ Kolirin, Lianne (2023-04-18). "Artist rejects photo prize after AI-generated image wins award" (in en). https://www.cnn.com/style/article/ai-photo-win-sony-scli-intl/index.html. 
  40. ↑ "How Generative AI Can Augment Human Creativity". Harvard Business Review. 2023-06-16. ISSN 0017-8012. https://hbr.org/2023/07/how-generative-ai-can-augment-human-creativity. 
  41. ↑ Thomas, Ryan J.; Thomson, T. J. (2023-07-07). "What Does a Journalist Look like? Visualizing Journalistic Roles through AI" (in en). Digital Journalism: 1–23. doi:10.1080/21670811.2023.2229883. ISSN 2167-0811. 
  42. ↑ Alba, Davey (August 11, 2023). "Midjourney Is Easily Tricked Into Making AI Misinformation, Study Finds". Bloomberg. ISSN 1063-2123. https://www.bloomberg.com/news/newsletters/2023-08-11/midjourney-rules-can-easily-break-with-certain-prompts. 
  43. ↑ McLaughlin, Sarah (31 March 2023). "Midjourney CEO Says 'Political Satire In China Is Pretty Not Okay,' But Apparently Silencing Satire About Xi Jinping Is Pretty Okay". https://www.techdirt.com/2023/03/31/midjourney-ceo-says-political-satire-in-china-is-pretty-not-okay-but-apparently-silencing-satire-about-xi-jinping-is-pretty-okay/. 
  44. ↑ McFadden, Christopher (2023-04-03). "Midjourney will no longer let you generate images of Xi Jinping" (in en-US). https://interestingengineering.com/culture/midjourney-bans-xi-jinping-images. 
  45. ↑ Bastian, Matthias (2023-05-03). "Midjourney now has an easy mode and a new AI moderation system" (in en-US). https://the-decoder.com/midjourney-now-has-an-easy-mode-and-a-new-ai-moderation-system/. 
  46. ↑ Vincent, James (2023-01-16). "AI art tools Stable Diffusion and Midjourney targeted with copyright lawsuit". https://www.theverge.com/2023/1/16/23557098/generative-ai-art-copyright-legal-lawsuit-stable-diffusion-midjourney-deviantart. 
  47. ↑ Brittain, Blake (2023-07-19). "US judge finds flaws in artists' lawsuit against AI companies" (in en). Reuters. https://www.reuters.com/legal/litigation/us-judge-finds-flaws-artists-lawsuit-against-ai-companies-2023-07-19/. 
  48. ↑ "Midjourney Subscription Plans" (in en). https://docs.midjourney.com/docs/plans. 
  49. ↑ "Midjourney Subscription Plans" (in en). https://docs.midjourney.com/docs/plans. 

External links




Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Midjourney&oldid=3467272"