ranguba/ranguba-server at a77ae9a [master] Replace invalid characters (Groonga-commit) - Groonga - fulltext search engine.

Kouhei Sutou	2017-02-22 01:02:10 +0900 (Wed, 22 Feb 2017)

  New Revision: a77ae9a75338033badc09b842650ee98ab16bcf9
  https://github.com/ranguba/ranguba-server/commit/a77ae9a75338033badc09b842650ee98ab16bcf9

  Message:
    Replace invalid characters

  Modified files:
    app/models/scraping.rb

  Modified: app/models/scraping.rb (+3 -1)
===================================================================

--- app/models/scraping.rb    2017-02-22 00:37:56 +0900 (e1ad13e)
+++ app/models/scraping.rb    2017-02-22 01:02:10 +0900 (bbdadce)
@@ -19,7 +19,9 @@ class Scraping
     texts = []
     size = 0
     extractor.extract(data) do |extracted_data|
-      text = extracted_data.body
+      text = extracted_data.body.encode(Encoding::UTF_8,
+                                        :invalid => :replace,
+                                        :undef => :replace)
       texts << text
       size += text.bytesize
     end
-------------- next part --------------
HTML����������������������������...
Descargar 


Groonga - fulltext search engine.

[Groonga-commit] ranguba/ranguba-server at a77ae9a [master] Replace invalid characters