消息系统设计要点

操作系统

消息传递作为进程间通信的重要一种，他提供了网络间进程通信的方式。但是相比于管程和信号量等，他具有不稳定性。

需要考的问题简单来说有这么几点

消息传递的不可靠性解决。在网络间传递时，A到B已经发送了消息，B可能没有收到，A要有一种机制可以知道B已经收到了消息。因此，B需要发送一个ACknowledge给A，来保证他已经收到。
消息传递的重复性。在A重复的发送了数据后，如果经过一定的时间后，A没有收到ACK，所以又重复发了一次相同的message，但是经过一段时间后，B收到了两个相同消息，如何进行区分？可以在发送的消息中加入连续的序列来表达不同的消息。
还有许多其他问题，这里直说两个比较普遍的问题。

Comments

Elasticsearch error when the field exceed limit 32kb

When we post data that the field exceed the limit, elasticsearch will reject the data which error: {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[cs19-2][10.200.20.39:9301][indices:data/write/index]"}],"type":"illegal_argument_exception","reason":"Document contains at least one immense term in field=\"field1\" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is You can handle this: 1. you can udpate the mapping part at any time PUT INDEXNAME/_mapping/TYPENAME { "properties" : { "logInfo" : { "type" : "string" , "analyzer" : "keyword" , "ignore_above" : 32766 } } } ignore_above means that we will only keep 32766 bytes 2...

Scrapy ERROR :ImportError: Error loading object 'scrapy.telnet.TelnetConsole': No module named conch

原文: https://stackoverflow.com/questions/17263509/error-while-using-scrapy-scrapy-telnet-telnetconsole-no-module-named-conch/17264705#17264705 On Ubuntu, you should avoid using easy_install wherever you can. Instead, you should be using apt-get , aptitude , "Ubuntu Software Center", or another of the distribution-provided tools. For example, this single command is all you need to install scrapy - along with every one of its dependencies that is not already installed: $ sudo apt - get install python - scrapy easy_install is not nearly as good at installing things as apt-get . Chances are the reason you can't get it to work is that it didn't quite install things sensibly, particularly with respect to what was already installed on the system. Sadly, it also leaves no record of what it did, so uninstallation is difficult or impossible. You may now have a big mess on your system that prevents proper installations from working as well (or maybe not...

学习服务器配置之路~~

第一个常见的小问题：MySQL安装 os : fedora 20 mysql: mysql-server(5.5) 所有假设你的系统是没有经过特殊配置的。 1: yum install mysql-server 2: mysql 报错：socket连接不上 3： service mysqld start 注意这步是 mysqld 不是mysql 这样就解决。网上的方法好像有点麻烦。第二个小问题：解压一些文件(.tar.gz)时报错 http://itsfoss.com/how-solve-stdin-gzip-format/ 上面介绍的很清楚，总之要先确认你下载的文件类型。第三个小问题。配置tomcat服务器主要问题是比如我的域名是 cqupt.me 而你tomcat服务器的项目在/webapps/{your projectname} 这时你很蛋疼的要 cqupt.me:8080/{your projectname}/index.html。如果要cqupt.me就可以完成。这样配置：都是在tomcat下/conf/server.xml 第一步端口。简单不废话第二部。 <Host name="localhost" appBase="webapps" unpackWARs="true" autoDeploy="true" xmlValidation="false" xmlNamespaceAware="false"> </Host> 在标签中间插入： <Context path="" docBase="xbwl" debug="0" reloadable="true"/> docBase="xbwl" xbwl 即为指定的项目。即（{your projectname}_ 完整如下： <Host name="localhost" appBase="webapps" ...

Jason Zhang

Search This Blog