Sep 26 17:17:30 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 26 17:17:30 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 26 17:17:30 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 26 17:17:32 devstack cinder-volume[75858]: INFO dbcounter [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Registered counter for database cinder Sep 26 17:17:32 devstack cinder-volume[75858]: DEBUG oslo_db.sqlalchemy.engines [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:17:33 devstack cinder-volume[75858]: DEBUG dbcounter [-] [75858] Writer thread running {{(pid=75858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 26 17:17:33 devstack cinder-volume[75858]: INFO cinder.rpc [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 26 17:17:33 devstack cinder-volume[75858]: INFO cinder.rpc [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 26 17:17:33 devstack cinder-volume[75858]: DEBUG oslo_db.sqlalchemy.engines [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:17:33 devstack cinder-volume[75858]: INFO cinder.volume.manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Determined volume DB was empty at startup. Sep 26 17:17:33 devstack cinder-volume[75858]: DEBUG cinder.volume.manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75858) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 26 17:17:33 devstack cinder-volume[75858]: INFO cinder.volume.manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 26 17:17:33 devstack cinder-volume[75858]: WARNING stevedore.named [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 26 17:17:33 devstack cinder-volume[75858]: WARNING castellan.key_manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 26 17:17:33 devstack cinder-volume[75858]: WARNING cinder.keymgr.conf_key_mgr [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 26 17:17:33 devstack cinder-volume[75858]: DEBUG cinder.volume.drivers.lvm [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75858) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 26 17:17:33 devstack cinder-volume[75858]: DEBUG oslo_concurrency.processutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:34 devstack cinder-volume[75858]: DEBUG oslo_concurrency.processutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] CMD "cinder-rtstool verify" returned: 0 in 1.027s {{(pid=75858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:34 devstack cinder-volume[75858]: DEBUG oslo_db.sqlalchemy.engines [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:17:34 devstack cinder-volume[75858]: INFO cinder.rpc [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 26 17:17:34 devstack cinder-volume[75858]: INFO cinder.rpc [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 26 17:17:34 devstack cinder-volume[75858]: WARNING stevedore.named [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 26 17:17:34 devstack cinder-volume[75858]: WARNING castellan.key_manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 26 17:17:34 devstack cinder-volume[75858]: INFO cinder.volume.manager [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 26 17:17:34 devstack cinder-volume[75858]: DEBUG oslo_db.sqlalchemy.engines [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:17:35 devstack cinder-volume[75858]: INFO oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Starting 1 workers Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Started child 75990 {{(pid=75858) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Full set of CONF: {{(pid=75858) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] ******************************************************************************** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Configuration options gathered from: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] ================================================================================ {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] allow_availability_zone_fallback = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] allow_compression_on_image_upload = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] allowed_direct_url_schemes = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] api_rate_limit = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] auth_strategy = keystone {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] az_cache_duration = 3600 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_availability_zone = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_host = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_stats_polling_interval = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backup_api_class = cinder.backup.api.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backup_name_template = backup-%s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backup_use_same_host = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backup_use_temp_snapshot = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] chap_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] chap_username = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_internal_tenant_project_id = b47e2ba1376446de939c0eb822f2e19d {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_internal_tenant_user_id = 14c632c4c73e4af19aa7e1200c9add56 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cloned_volume_same_az = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cluster = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] compression_format = gzip {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] compute_api_class = cinder.compute.nova.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] config_dir = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] config_source = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75990]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] control_exchange = openstack {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] debug = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] default_availability_zone = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] default_group_type = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] default_volume_type = lvmdriver-1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_client_cert = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_client_cert_key = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_data_namespace = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_ssl_cert_path = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_ssl_cert_verify = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] driver_use_ssl = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] enable_force_upload = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] enable_new_services = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] enable_unsupported_driver = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] enforce_multipath_for_image_xfer = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] filter_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_api_insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_api_servers = ['http://192.168.122.210/image'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_api_ssl_compression = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_ca_certificates_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_catalog_info = image:glance:publicURL {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_num_retries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance_request_timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] goodness_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] graceful_shutdown_timeout = 5 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] group_api_class = cinder.group.api.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] host = devstack {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_compress_on_upload = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_conversion_address_space_limit = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_conversion_cpu_limit = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_conversion_disable = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_upload_use_cinder_backend = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_upload_use_internal_tenant = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_volume_cache_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_volume_cache_max_count = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] image_volume_cache_max_size_gb = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] init_host_max_objects_retrieval = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] instance_format = [instance: %(uuid)s] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iscsi_iotype = fileio {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iscsi_target_flags = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iscsi_write_cache = on {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iser_helper = tgtadm {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iser_ip_address = 192.168.122.210 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iser_port = 3260 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_color = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_config_append = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_dir = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_options = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_rotate_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_rotate_interval_type = days {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] log_rotation_type = none {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] max_age = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] max_logfile_count = 30 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] max_logfile_size_mb = 200 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] max_over_subscription_ratio = 20.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] message_reap_interval = 86400 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] message_ttl = 2592000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] migration_create_volume_timeout_secs = 300 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] monkey_patch = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] monkey_patch_modules = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] my_ip = 192.168.122.210 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] no_snapshot_gb_quota = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] num_iser_scan_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] num_shell_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] num_volume_device_scan_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] nvmeof_conn_info_version = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] nvmet_ns_id = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] nvmet_port_id = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_max_limit = 1000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_ext_list = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_listen_port = 8776 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_use_ssl = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] osapi_volume_workers = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] per_volume_size_limit = -1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] periodic_fuzzy_delay = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] periodic_interval = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] public_endpoint = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] publish_errors = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_backup_gigabytes = 1000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_backups = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_gigabytes = 1000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_groups = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_snapshots = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] quota_volumes = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] rate_limit_burst = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] rate_limit_except_level = CRITICAL {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] rate_limit_interval = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] reinit_driver_count = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] replication_device = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] report_discard_supported = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] report_interval = 120 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] reservation_clean_interval = 86400 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] reservation_expire = 86400 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] reserved_image_namespaces = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] reserved_percentage = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] rpc_response_timeout = 120 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] run_external_periodic_tasks = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] scst_target_driver = iscsi {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] scst_target_iqn_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_down_time = 720 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] shell_completion = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] snapshot_name_template = snapshot-%s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] snapshot_same_host = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] split_loggers = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] state_path = /opt/stack/data/cinder {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] storage_availability_zone = nova {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] storage_protocol = iSCSI {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] syslog_log_facility = LOG_USER {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_helper = lioadm {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_ip_address = 192.168.122.210 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_port = 3260 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_protocol = iscsi {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] target_secondary_ip_addresses = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] trace_flags = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] transport_url = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] until_refresh = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_chap_auth = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_default_quota_class = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_journal = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_json = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_multipath_for_image_xfer = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_stderr = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] use_syslog = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] verify_glance_signatures = enabled {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_api_class = cinder.volume.api.API {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_backend_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_clear = zero {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_clear_ionice = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_clear_size = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_copy_bps_limit = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_dd_blocksize = 1M {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_name_template = volume-%s {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_service_inithost_offload = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volume_usage_audit_period = month {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] watch_log_file = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] zoning_mode = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.admin_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.admin_token = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.admin_user = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_port = 35357 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_protocol = https {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_section = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_type = password {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_uri = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.auth_version = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.cache = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.identity_uri = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.include_service_catalog = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.interface = public {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_password = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcache_username = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.region_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.service_type = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.backend = dogpile.cache.null {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.backend_argument = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.backend_expiration_time = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.config_prefix = cache.oslo {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.dead_timeout = 60.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.debug_cache_backend = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.enable_retry_client = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.enable_socket_keepalive = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.enforce_fips_mode = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.expiration_time = 600 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_dead_retry = 300 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_pool_maxsize = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_sasl_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.memcache_username = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.proxies = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_db = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_server = localhost:6379 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_socket_timeout = 1.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.redis_username = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.retry_attempts = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.retry_delay = 0.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.socket_keepalive_count = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.socket_keepalive_idle = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.socket_keepalive_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.tls_allowed_ciphers = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.tls_cafile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.tls_certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.tls_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cache.tls_keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] coordination.backend_url = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.asyncio_connection = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.asyncio_slave_connection = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.backend = sqlalchemy {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.connection = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.connection_debug = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.connection_parameters = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.connection_recycle_time = 3600 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.connection_trace = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.db_inc_retry_interval = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.db_max_retries = 20 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.db_max_retry_interval = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.db_retry_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.max_overflow = 50 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.max_pool_size = 5 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.max_retries = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.pool_timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.retry_interval = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.slave_connection = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.sqlite_synchronous = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] database.use_db_reconnect = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.connection_string = messaging:// {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.es_doc_type = notification {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.es_scroll_size = 10000 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.es_scroll_time = 2m {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.filter_error_trace = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.hmac_keys = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.sentinel_service_name = mymaster {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.socket_timeout = 0.1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.trace_requests = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler.trace_sqlalchemy = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler_jaeger.process_tags = {} {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] profiler_otlp.service_name_prefix = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.enforce_new_defaults = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: WARNING oslo_config.cfg [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.enforce_scope = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.policy_default_rule = default {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.policy_file = policy.yaml {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.group = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.helper_command = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] privsep_osbrick.user = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.group = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.helper_command = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] cinder_sys_admin.user = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.auth_section = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.auth_type = password {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.collect_timing = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.send_service_user_token = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.split_loggers = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] service_user.timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.auth_section = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.auth_type = password {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.collect_timing = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.split_loggers = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] glance.timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.backend_availability_zone = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.chap_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.chap_username = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_client_cert = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_client_cert_key = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_data_namespace = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.driver_use_ssl = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.extra_capabilities = {} {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.filter_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.goodness_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iscsi_target_flags = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iscsi_write_cache = on {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iser_helper = tgtadm {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iser_ip_address = 192.168.122.210 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iser_port = 3260 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.lvm_share_target = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.lvm_type = auto {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.num_shell_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.replication_device = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.report_discard_supported = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.reserved_percentage = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_helper = tgtadm {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_ip_address = 192.168.122.210 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_port = 3260 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_protocol = iscsi {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.trace_flags = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.unique_fqdn_network = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.use_chap_auth = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_backend_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_clear = zero {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_clear_ionice = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_clear_size = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_reports.file_event_handler = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_reports.log_dir = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.backend_host = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.chap_password = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.chap_username = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_client_cert = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.extra_capabilities = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.filter_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.goodness_function = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iser_helper = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iser_ip_address = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iser_port = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.lvm_share_target = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.lvm_type = auto {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75990]: INFO cinder.volume.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.num_shell_tries = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.replication_device = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.report_discard_supported = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.reserved_percentage = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.scst_target_driver = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.storage_protocol = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_helper = lioadm {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_ip_address = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_port = 3260 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.trace_flags = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.use_chap_auth = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_clear = zero {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_clear_size = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] lvmdriver-1.volumes_dir = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_notifications.driver = [] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] key_manager.fixed_key = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.barbican_api_version = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.barbican_endpoint = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.barbican_endpoint_type = public {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.barbican_region_name = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.cafile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.collect_timing = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.number_of_retries = 60 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.retry_delay = 1 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.send_service_user_token = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.split_loggers = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.verify_ssl = True {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican.verify_ssl_path = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.auth_section = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.auth_type = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.cafile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.certfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.collect_timing = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.insecure = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.keyfile = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.split_loggers = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] barbican_service_user.timeout = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.approle_role_id = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.approle_secret_id = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.kv_mountpoint = secret {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.kv_path = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.kv_version = 2 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.namespace = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.root_token_id = **** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.ssl_ca_crt_file = None {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.timeout = 60.0 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.use_ssl = False {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:17:35 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] ******************************************************************************** {{(pid=75858) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 26 17:17:35 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.176s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:35 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:36 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.112s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:36 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:36 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.106s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:36 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:36 devstack sudo[76070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 26 17:17:36 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:38 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:38 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.944s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:38 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:38 devstack sudo[76191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:17:38 devstack sudo[76191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:40 devstack sudo[76191]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:40 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.959s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:40 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:17:40 devstack cinder-volume[75990]: INFO cinder.brick.local_dev.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 26 17:17:40 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:40 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:40 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:40 devstack sudo[76298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:17:40 devstack sudo[76298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:42 devstack sudo[76298]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:42 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.888s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:42 devstack cinder-volume[75990]: DEBUG cinder.brick.local_dev.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75990) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 26 17:17:42 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:42 devstack sudo[76388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:17:42 devstack sudo[76388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:45 devstack cinder-volume[75858]: DEBUG dbcounter [-] [75858] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:17:45 devstack sudo[76388]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:45 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.476s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:45 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:45 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:45 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:45 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:17:45 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:47 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:47 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.915s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:47 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:47 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:47 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:47 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 26 17:17:47 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:50 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:50 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.208s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:50 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:50 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:17:50 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:52 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:52 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.716s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:52 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:52 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:17:52 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:55 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:55 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.542s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:55 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:55 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:17:55 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:17:58 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Sep 26 17:17:58 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.741s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:17:58 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:17:58 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:17:58 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:00 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:00 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.150s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:00 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:00 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.105s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:00 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:00 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:18:00 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:02 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:02 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.912s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:02 devstack cinder-volume[75990]: INFO cinder.volume.drivers.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 26 17:18:02 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:02 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:02 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:02 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:18:02 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:04 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:04 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.792s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:04 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:18:04 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:04 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:18:04 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:06 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:06 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.963s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:06 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:06 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:06 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:08 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:08 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.878s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:08 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:08 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:18:08 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:10 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:10 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.909s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:10 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:10 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:10 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:12 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.180s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:12 devstack cinder-volume[75990]: INFO cinder.volume.driver [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Driver hasn't implemented _init_vendor_properties() Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG cinder.volume.driver [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75990) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG oslo_db.sqlalchemy.engines [None req-621644bc-f517-4270-92bf-883796dd1784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writer thread running {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG cinder.db.sqlalchemy.api [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Building query based on filter {{(pid=75990) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG cinder.image.image_utils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75990) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 26 17:18:12 devstack cinder-volume[75990]: INFO cinder.keymgr.migration [None req-d8312640-f191-4577-b766-814881c928d1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:18:12 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:12 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:18:12 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:14 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:14 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.046s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:14 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:14 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:14 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:16 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:16 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:16 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:16 devstack sudo[77164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:18:16 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:18 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:18 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.887s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:18 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:18 devstack sudo[77167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:18 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:20 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.793s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:18:20 devstack cinder-volume[75990]: INFO cinder.volume.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Driver initialization completed successfully. Sep 26 17:18:20 devstack cinder-volume[75990]: INFO cinder.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Initiating service 2 cleanup Sep 26 17:18:20 devstack cinder-volume[75990]: INFO cinder.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Service 2 cleanup completed. Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG cinder.service [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Creating RPC server for service cinder-volume {{(pid=75990) start /opt/stack/cinder/cinder/service.py:239}} Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG cinder.service [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75990) start /opt/stack/cinder/cinder/service.py:245}} Sep 26 17:18:20 devstack cinder-volume[75990]: INFO cinder.volume.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:18:20 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:21 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:18:21 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:22 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:22 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.825s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:22 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:22 devstack sudo[77178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:22 devstack sudo[77178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:24 devstack sudo[77178]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:24 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.928s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:24 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:24 devstack sudo[77182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:18:24 devstack sudo[77182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:27 devstack sudo[77182]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:27 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.289s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:27 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:18:27 devstack sudo[77190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:18:27 devstack sudo[77190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:18:28 devstack sudo[77190]: pam_unix(sudo:session): session closed for user root Sep 26 17:18:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-621644bc-f517-4270-92bf-883796dd1784 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.776s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:18:29 devstack cinder-volume[75990]: INFO cinder.volume.manager [None req-621644bc-f517-4270-92bf-883796dd1784 None None] Driver post RPC initialization completed successfully. Sep 26 17:18:39 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writing DB stats cinder:SELECT=3 {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:18:39 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:19:25 devstack cinder-volume[75990]: DEBUG oslo_service.periodic_task [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:19:25 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:19:25 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:19:25 devstack sudo[78537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:19:25 devstack sudo[78537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:19:26 devstack sudo[78537]: pam_unix(sudo:session): session closed for user root Sep 26 17:19:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.843s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:19:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:19:27 devstack sudo[78545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:19:27 devstack sudo[78545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:19:28 devstack sudo[78545]: pam_unix(sudo:session): session closed for user root Sep 26 17:19:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.687s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:19:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:19:28 devstack sudo[78555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:19:28 devstack sudo[78555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:19:30 devstack sudo[78555]: pam_unix(sudo:session): session closed for user root Sep 26 17:19:30 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.015s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:19:30 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:19:30 devstack sudo[78560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:19:30 devstack sudo[78560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:19:32 devstack sudo[78560]: pam_unix(sudo:session): session closed for user root Sep 26 17:19:32 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.896s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:19:32 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:20:25 devstack cinder-volume[75990]: DEBUG oslo_service.periodic_task [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:20:25 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:20:25 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:20:25 devstack sudo[79169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:20:25 devstack sudo[79169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:20:26 devstack sudo[79169]: pam_unix(sudo:session): session closed for user root Sep 26 17:20:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.847s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:20:27 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:20:27 devstack sudo[79282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:20:27 devstack sudo[79282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:20:28 devstack sudo[79282]: pam_unix(sudo:session): session closed for user root Sep 26 17:20:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.948s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:20:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:20:29 devstack sudo[79292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:20:29 devstack sudo[79292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:20:31 devstack sudo[79292]: pam_unix(sudo:session): session closed for user root Sep 26 17:20:31 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.293s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:20:31 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:20:31 devstack sudo[79297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:20:31 devstack sudo[79297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:20:33 devstack sudo[79297]: pam_unix(sudo:session): session closed for user root Sep 26 17:20:33 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.910s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:20:33 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:20:39 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:21:25 devstack cinder-volume[75990]: DEBUG oslo_service.periodic_task [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:21:25 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:21:25 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:21:25 devstack sudo[82075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:21:25 devstack sudo[82075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:21:26 devstack sudo[82075]: pam_unix(sudo:session): session closed for user root Sep 26 17:21:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.778s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:21:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:21:27 devstack sudo[82078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:21:27 devstack sudo[82078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:21:28 devstack sudo[82078]: pam_unix(sudo:session): session closed for user root Sep 26 17:21:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.979s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:21:28 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:21:29 devstack sudo[82082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:21:29 devstack sudo[82082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:21:30 devstack sudo[82082]: pam_unix(sudo:session): session closed for user root Sep 26 17:21:30 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.842s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:21:30 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:21:30 devstack sudo[82086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:21:30 devstack sudo[82086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:21:32 devstack sudo[82086]: pam_unix(sudo:session): session closed for user root Sep 26 17:21:32 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.716s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:21:32 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:22:25 devstack cinder-volume[75990]: DEBUG oslo_service.periodic_task [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:22:25 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:22:25 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:22:25 devstack sudo[82379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:22:25 devstack sudo[82379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:22:26 devstack sudo[82379]: pam_unix(sudo:session): session closed for user root Sep 26 17:22:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.791s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:22:26 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:22:27 devstack sudo[82382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:22:27 devstack sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:22:28 devstack sudo[82382]: pam_unix(sudo:session): session closed for user root Sep 26 17:22:29 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.058s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:22:29 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:22:29 devstack sudo[82386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:22:29 devstack sudo[82386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:22:30 devstack sudo[82386]: pam_unix(sudo:session): session closed for user root Sep 26 17:22:31 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.960s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:22:31 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:22:31 devstack sudo[82389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:22:31 devstack sudo[82389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:22:32 devstack sudo[82389]: pam_unix(sudo:session): session closed for user root Sep 26 17:22:32 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.750s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:22:32 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:22:39 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writing DB stats cinder:SELECT=1 {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:22:39 devstack cinder-volume[75990]: DEBUG dbcounter [-] [75990] Writing DB stats cinder:UPDATE=1 {{(pid=75990) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:23:25 devstack cinder-volume[75990]: DEBUG oslo_service.periodic_task [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75990) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:23:25 devstack cinder-volume[75990]: DEBUG cinder.volume.drivers.lvm [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Updating volume stats {{(pid=75990) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 26 17:23:25 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:23:25 devstack sudo[83049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 26 17:23:25 devstack sudo[83049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:23:27 devstack sudo[83049]: pam_unix(sudo:session): session closed for user root Sep 26 17:23:27 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.473s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:23:27 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:23:27 devstack sudo[83064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:23:27 devstack sudo[83064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:23:30 devstack sudo[83064]: pam_unix(sudo:session): session closed for user root Sep 26 17:23:30 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.282s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:23:31 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:23:31 devstack sudo[83107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 26 17:23:31 devstack sudo[83107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:23:33 devstack sudo[83107]: pam_unix(sudo:session): session closed for user root Sep 26 17:23:33 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.638s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:23:33 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:23:33 devstack sudo[83147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 26 17:23:33 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:23:35 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root Sep 26 17:23:35 devstack cinder-volume[75990]: DEBUG oslo_concurrency.processutils [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.048s {{(pid=75990) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:23:35 devstack cinder-volume[75990]: DEBUG cinder.manager [None req-dad05ec5-8d4e-488d-b599-acbcd33c0fbd None None] Notifying Schedulers of capabilities ... {{(pid=75990) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:23:43 devstack cinder-volume[75858]: INFO oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Caught SIGTERM, stopping children Sep 26 17:23:43 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Acquiring lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 26 17:23:43 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Acquired lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 26 17:23:43 devstack cinder-volume[75858]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Releasing lock "singleton_lock" {{(pid=75858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 26 17:23:43 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Stop services. {{(pid=75858) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 26 17:23:43 devstack cinder-volume[75858]: DEBUG oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Killing children. {{(pid=75858) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 26 17:23:43 devstack cinder-volume[75858]: INFO oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Waiting on 1 children to exit Sep 26 17:23:46 devstack cinder-volume[75990]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Acquiring lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 26 17:23:46 devstack cinder-volume[75990]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Acquired lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 26 17:23:46 devstack cinder-volume[75990]: DEBUG oslo_concurrency.lockutils [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Releasing lock "singleton_lock" {{(pid=75990) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 26 17:23:46 devstack cinder-volume[75990]: WARNING amqp [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 26 17:23:46 devstack cinder-volume[75990]: WARNING amqp [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 26 17:23:46 devstack cinder-volume[75858]: INFO oslo_service.backend._eventlet.service [None req-75322ac1-814f-437a-b7ba-98a956228ba3 None None] Child 75990 exited with status 0 Sep 26 17:24:03 devstack cinder-volume[83412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83412) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 26 17:24:03 devstack cinder-volume[83412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83412) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 26 17:24:03 devstack cinder-volume[83412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83412) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 26 17:24:06 devstack cinder-volume[83412]: INFO dbcounter [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Registered counter for database cinder Sep 26 17:24:06 devstack cinder-volume[83412]: DEBUG oslo_db.sqlalchemy.engines [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:24:07 devstack cinder-volume[83412]: DEBUG dbcounter [-] [83412] Writer thread running {{(pid=83412) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 26 17:24:07 devstack cinder-volume[83412]: INFO cinder.rpc [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 26 17:24:07 devstack cinder-volume[83412]: INFO cinder.rpc [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 26 17:24:07 devstack cinder-volume[83412]: DEBUG oslo_db.sqlalchemy.engines [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:24:07 devstack cinder-volume[83412]: INFO cinder.volume.manager [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Determined volume DB was empty at startup. Sep 26 17:24:07 devstack cinder-volume[83412]: DEBUG cinder.volume.manager [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83412) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 26 17:24:07 devstack cinder-volume[83412]: INFO cinder.volume.manager [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 26 17:24:07 devstack cinder-volume[83412]: WARNING stevedore.named [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 26 17:24:07 devstack cinder-volume[83412]: WARNING castellan.key_manager [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 26 17:24:07 devstack cinder-volume[83412]: WARNING cinder.keymgr.conf_key_mgr [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 26 17:24:08 devstack cinder-volume[83412]: INFO cinder.volume.manager [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_db.sqlalchemy.engines [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:24:08 devstack cinder-volume[83412]: INFO oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Starting 1 workers Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Started child 83624 {{(pid=83412) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Full set of CONF: {{(pid=83412) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] ******************************************************************************** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Configuration options gathered from: {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] ================================================================================ {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 26 17:24:08 devstack cinder-volume[83624]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] allow_availability_zone_fallback = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] allow_compression_on_image_upload = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] allowed_direct_url_schemes = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] api_rate_limit = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] auth_strategy = keystone {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_availability_zone = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_host = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_stats_polling_interval = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backup_api_class = cinder.backup.api.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backup_name_template = backup-%s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backup_use_same_host = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backup_use_temp_snapshot = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] chap_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] chap_username = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_internal_tenant_project_id = b47e2ba1376446de939c0eb822f2e19d {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_internal_tenant_user_id = 14c632c4c73e4af19aa7e1200c9add56 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cluster = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] compression_format = gzip {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] compute_api_class = cinder.compute.nova.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] config_dir = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] config_source = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] control_exchange = openstack {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] debug = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] default_availability_zone = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] default_group_type = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] default_volume_type = QuobyteHD {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_client_cert = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_client_cert_key = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_data_namespace = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_ssl_cert_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_ssl_cert_verify = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] driver_use_ssl = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] enable_new_services = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] enable_unsupported_driver = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] enabled_backends = ['QuobyteHD'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] enforce_multipath_for_image_xfer = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] filter_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_api_insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_api_servers = ['http://192.168.122.210/image'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_api_ssl_compression = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_ca_certificates_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_catalog_info = image:glance:publicURL {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_num_retries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance_request_timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] goodness_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] graceful_shutdown_timeout = 5 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] group_api_class = cinder.group.api.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] host = devstack {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_compress_on_upload = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_conversion_address_space_limit = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_conversion_cpu_limit = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_conversion_disable = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_upload_use_cinder_backend = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_upload_use_internal_tenant = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_volume_cache_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_volume_cache_max_count = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] image_volume_cache_max_size_gb = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] init_host_max_objects_retrieval = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] instance_format = [instance: %(uuid)s] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iscsi_iotype = fileio {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iscsi_target_flags = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iscsi_write_cache = on {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iser_helper = tgtadm {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iser_ip_address = 192.168.122.210 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iser_port = 3260 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_color = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_config_append = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_dir = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_options = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_rotate_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_rotate_interval_type = days {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] log_rotation_type = none {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] max_age = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] max_logfile_count = 30 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] max_logfile_size_mb = 200 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] max_over_subscription_ratio = 20.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] message_reap_interval = 86400 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] message_ttl = 2592000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] migration_create_volume_timeout_secs = 300 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] monkey_patch = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] monkey_patch_modules = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] my_ip = 192.168.122.210 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] no_snapshot_gb_quota = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] num_iser_scan_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] num_shell_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] num_volume_device_scan_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] nvmeof_conn_info_version = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] nvmet_ns_id = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] nvmet_port_id = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_max_limit = 1000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_ext_list = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_listen_port = 8776 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_use_ssl = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] osapi_volume_workers = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] per_volume_size_limit = -1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] periodic_fuzzy_delay = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] periodic_interval = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] public_endpoint = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] publish_errors = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_backup_gigabytes = 1000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_backups = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_gigabytes = 1000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_groups = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_snapshots = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] quota_volumes = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] rate_limit_burst = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] rate_limit_except_level = CRITICAL {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] rate_limit_interval = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] reinit_driver_count = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] replication_device = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] report_discard_supported = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] report_interval = 120 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] reservation_clean_interval = 86400 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] reservation_expire = 86400 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] reserved_image_namespaces = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] reserved_percentage = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] rpc_response_timeout = 120 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] run_external_periodic_tasks = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] scst_target_driver = iscsi {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] scst_target_iqn_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_down_time = 720 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] shell_completion = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] snapshot_name_template = snapshot-%s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] split_loggers = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] state_path = /opt/stack/data/cinder {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] storage_availability_zone = nova {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] storage_protocol = iSCSI {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] syslog_log_facility = LOG_USER {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_helper = lioadm {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_ip_address = 192.168.122.210 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_port = 3260 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_protocol = iscsi {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] target_secondary_ip_addresses = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] trace_flags = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] transport_url = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] until_refresh = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_chap_auth = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_default_quota_class = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_journal = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_json = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_multipath_for_image_xfer = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_stderr = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] use_syslog = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] verify_glance_signatures = enabled {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_api_class = cinder.volume.api.API {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_backend_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_clear = zero {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_clear_ionice = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_clear_size = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_copy_bps_limit = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_dd_blocksize = 1M {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_name_template = volume-%s {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_service_inithost_offload = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volume_usage_audit_period = month {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] watch_log_file = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] zoning_mode = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_concurrency.disable_process_locking = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.admin_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.admin_token = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.admin_user = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_port = 35357 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_protocol = https {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_section = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_type = password {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_uri = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.auth_version = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.cache = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.identity_uri = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.include_service_catalog = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.interface = public {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_password = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83624) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcache_username = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.region_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.service_type = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.backend = dogpile.cache.null {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.backend_argument = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.backend_expiration_time = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.config_prefix = cache.oslo {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.dead_timeout = 60.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.debug_cache_backend = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.enable_retry_client = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.enable_socket_keepalive = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.enforce_fips_mode = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.expiration_time = 600 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.hashclient_retry_attempts = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.hashclient_retry_delay = 1.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_dead_retry = 300 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_pool_maxsize = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_sasl_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_socket_timeout = 1.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.memcache_username = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.proxies = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_db = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_server = localhost:6379 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_socket_timeout = 1.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.redis_username = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.retry_attempts = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.retry_delay = 0.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.socket_keepalive_count = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.socket_keepalive_idle = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.socket_keepalive_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.tls_allowed_ciphers = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.tls_cafile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.tls_certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.tls_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cache.tls_keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] coordination.backend_url = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.asyncio_connection = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.asyncio_slave_connection = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.backend = sqlalchemy {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.connection = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.connection_debug = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.connection_parameters = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.connection_recycle_time = 3600 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.connection_trace = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.db_inc_retry_interval = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.db_max_retries = 20 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.db_max_retry_interval = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.db_retry_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.max_overflow = 50 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.max_pool_size = 5 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.max_retries = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.mysql_wsrep_sync_wait = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.pool_timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.retry_interval = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.slave_connection = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.sqlite_synchronous = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] database.use_db_reconnect = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.connection_string = messaging:// {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.es_doc_type = notification {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.es_scroll_size = 10000 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.es_scroll_time = 2m {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.filter_error_trace = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.hmac_keys = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.sentinel_service_name = mymaster {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.socket_timeout = 0.1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.trace_requests = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler.trace_sqlalchemy = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler_jaeger.process_tags = {} {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler_jaeger.service_name_prefix = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] profiler_otlp.service_name_prefix = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.enforce_new_defaults = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: WARNING oslo_config.cfg [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.enforce_scope = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.policy_default_rule = default {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.policy_file = policy.yaml {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.group = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.helper_command = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] privsep_osbrick.user = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.group = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.helper_command = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] cinder_sys_admin.user = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.auth_section = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.auth_type = password {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.collect_timing = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.send_service_user_token = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.split_loggers = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] service_user.timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.auth_section = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.auth_type = password {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.collect_timing = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.split_loggers = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] glance.timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.backend_availability_zone = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.chap_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.chap_username = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_client_cert = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_client_cert_key = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_data_namespace = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.driver_use_ssl = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.extra_capabilities = {} {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.filter_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.goodness_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iscsi_iotype = fileio {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iscsi_target_flags = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iscsi_write_cache = on {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iser_helper = tgtadm {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iser_ip_address = 192.168.122.210 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iser_port = 3260 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_host = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_login = admin {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_mount_options = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_private_key = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_share_path = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.num_shell_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.quobyte_volume_url = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.replication_device = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.report_discard_supported = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.reserved_percentage = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_helper = tgtadm {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_ip_address = 192.168.122.210 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_port = 3260 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_protocol = iscsi {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.trace_flags = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.unique_fqdn_network = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.use_chap_auth = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_backend_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_clear = zero {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_clear_ionice = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_clear_size = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_reports.file_event_handler = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_reports.log_dir = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.backend_availability_zone = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.backend_host = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83624) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 26 17:24:08 devstack cinder-volume[83624]: INFO cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.chap_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.chap_username = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.chiscsi_conf = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_client_cert = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_data_namespace = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Running cmd (subprocess): mount.quobyte {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.driver_use_ssl = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.extra_capabilities = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.filter_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.goodness_function = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iscsi_iotype = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iser_helper = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iser_ip_address = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iser_port = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.iser_target_prefix = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_host = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_login = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_mount_options = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_password = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_private_key = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_share_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_ssh_port = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.num_shell_tries = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.nvmet_port_id = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.replication_device = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.report_discard_supported = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.reserved_percentage = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.scst_target_driver = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.storage_protocol = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_helper = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_ip_address = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_port = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_prefix = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_protocol = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.trace_flags = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.use_chap_auth = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_clear = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_clear_size = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] QuobyteHD.volumes_dir = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_notifications.driver = [] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_notifications.retry = -1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] key_manager.fixed_key = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.barbican_api_version = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.barbican_endpoint = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.barbican_endpoint_type = public {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.barbican_region_name = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.cafile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.collect_timing = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.number_of_retries = 60 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.retry_delay = 1 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.send_service_user_token = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.split_loggers = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.verify_ssl = True {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican.verify_ssl_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.auth_section = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.auth_type = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.cafile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.certfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.collect_timing = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.insecure = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.keyfile = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.split_loggers = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] barbican_service_user.timeout = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.approle_role_id = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.approle_secret_id = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.kv_mountpoint = secret {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.kv_path = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.kv_version = 2 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.namespace = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.root_token_id = **** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.ssl_ca_crt_file = None {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.timeout = 60.0 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.use_ssl = False {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 26 17:24:08 devstack cinder-volume[83412]: DEBUG oslo_service.backend._eventlet.service [None req-e61262a4-ff01-4b68-8f15-ccac0d84b961 None None] ******************************************************************************** {{(pid=83412) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 26 17:24:08 devstack quobyte-client[83625]: Reading configuration file: /etc/quobyte/client.cfg Sep 26 17:24:08 devstack quobyte-client[83625]: Invalid parameters found, error: missing mount point. Sep 26 17:24:08 devstack quobyte-client[83625]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 26 17:24:08 devstack quobyte-client[83625]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] CMD "mount.quobyte" returned: 1 in 0.276s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:24:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:24:09 devstack cinder-volume[83624]: INFO cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Mounting volume: 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb ... Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a -c /etc/quobyte/client-cinder.cfg {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:24:09 devstack quobyte-client[83626]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 26 17:24:09 devstack quobyte-client[83626]: Reading configuration file: /etc/quobyte/client.cfg Sep 26 17:24:09 devstack quobyte-client[83626]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a' to display the log. Sep 26 17:24:09 devstack quobyte-client[83627]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 26 17:24:09 devstack quobyte-client[83627]: mount.quobyte 3.25 (4fbbd59204) Sep 26 17:24:09 devstack quobyte-client[83627]: Client UUID: 0C5Y42Kl-5ehi-wGHG-5NBj-qoGz6HISLNLs Sep 26 17:24:09 devstack quobyte-client[83627]: Registry: osci01.corp.quobyte.com:7861 Sep 26 17:24:09 devstack quobyte-client[83627]: Volume: cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:24:09 devstack quobyte-client[83627]: FUSE version: 316 Sep 26 17:24:09 devstack quobyte-client[83627]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 26 17:24:09 devstack quobyte-client[83627]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 26 17:24:09 devstack quobyte-client[83627]: Setting total object cache size to 3352297472 bytes Sep 26 17:24:09 devstack quobyte-client[83627]: Using FUSE low-level API Sep 26 17:24:09 devstack quobyte-client[83627]: Caching of uid/gid to user/group name mappings is enabled Sep 26 17:24:09 devstack quobyte-client[83627]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 26 17:24:09 devstack quobyte-client[83627]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 26 17:24:09 devstack quobyte-client[83627]: HTTP server started on port 55000 Sep 26 17:24:09 devstack quobyte-client[83627]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 26 17:24:09 devstack quobyte-client[83627]: Mount point /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a established Sep 26 17:24:09 devstack quobyte-client[83627]: TimeSync is running and remote sync every 60 seconds Sep 26 17:24:09 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:09 devstack quobyte-client[83627]: Ignored time synchronization message because time source took too long to respond (67 ms) Sep 26 17:24:09 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:09 devstack quobyte-client[83627]: Opening volume cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb (9ed423de-bfc5-490b-99b8-d6b480cd0db4) Sep 26 17:24:09 devstack quobyte-client[83627]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 26 17:24:09 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:09 devstack quobyte-client[83627]: Changed metadata cache configuration for volume 9ed423de-bfc5-490b-99b8-d6b480cd0db4 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false Sep 26 17:24:09 devstack quobyte-client[83627]: Failed to invalidate inode: 38: Function not implemented Sep 26 17:24:09 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:09 devstack quobyte-client[83627]: Automatic minidump upload enabled by global system configuration Sep 26 17:24:09 devstack quobyte-client[83627]: Announcing HTTP status server address 172.24.4.1 Sep 26 17:24:09 devstack quobyte-client[83627]: Registered as service (uuid 0C5Y42Kl-5ehi-wGHG-5NBj-qoGz6HISLNLs) Sep 26 17:24:09 devstack quobyte-client[83627]: Quobyte Client running as pid 83627 Sep 26 17:24:09 devstack quobyte-client[83627]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 26 17:24:09 devstack quobyte-client[83627]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.516s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:24:09 devstack cinder-volume[83624]: INFO cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Mounting volume: 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb succeeded Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.565s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:24:09 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.084s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:24:09 devstack cinder-volume[83624]: INFO cinder.volume.driver [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Driver hasn't implemented _init_vendor_properties() Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG cinder.volume.driver [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83624) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG oslo_db.sqlalchemy.engines [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writer thread running {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG cinder.db.sqlalchemy.api [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Building query based on filter {{(pid=83624) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 26 17:24:09 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83624) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 26 17:24:09 devstack cinder-volume[83624]: INFO cinder.keymgr.migration [None req-836414a6-0ad5-41e1-af6b-a811170c24de None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.073s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:24:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Driver initialization completed successfully. Sep 26 17:24:10 devstack cinder-volume[83624]: INFO cinder.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Initiating service 3 cleanup Sep 26 17:24:10 devstack cinder-volume[83624]: INFO cinder.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Service 3 cleanup completed. Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.service [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Creating RPC server for service cinder-volume {{(pid=83624) start /opt/stack/cinder/cinder/service.py:239}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.service [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83624) start /opt/stack/cinder/cinder/service.py:245}} Sep 26 17:24:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 26 17:24:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:24:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:24:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.109s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:24:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-719ada1a-3940-4bc4-a85c-f2e9a7f02a72 None None] Driver post RPC initialization completed successfully. Sep 26 17:24:12 devstack quobyte-client[83627]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 26 17:24:18 devstack cinder-volume[83412]: DEBUG dbcounter [-] [83412] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83412) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:24:20 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:24:20 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.109s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:25:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:25:26 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:25:26 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Flow 'volume_create_manager' (27cd33b8-cbc0-48b9-8ffb-895a10d7cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62e042d-d5d7-462f-8ca8-ee616d7d9df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62e042d-d5d7-462f-8ca8-ee616d7d9df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1418701938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16284c0d-0ff3-403a-8dce-e3fb54780c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5107f4e3e4163a9286484ef1b9684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:25:26Z,use_quota=True,user_id='b868a01245794b75bc68b96c4e238ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b1c89-4321-450d-ad62-d4d575f676f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8b1c89-4321-450d-ad62-d4d575f676f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abe3c6a-3de7-48c4-8e46-9351e51abb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abe3c6a-3de7-48c4-8e46-9351e51abb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16284c0d-0ff3-403a-8dce-e3fb54780c3e', 'volume_name': 'volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b516bbd-8ad3-40d0-8dfe-2d6531015841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b516bbd-8ad3-40d0-8dfe-2d6531015841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167588e0-44ed-4be1-b032-2b6729676821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:28 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume 16284c0d-0ff3-403a-8dce-e3fb54780c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e', 'volume_size': 1} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1418701938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16284c0d-0ff3-403a-8dce-e3fb54780c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5107f4e3e4163a9286484ef1b9684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:25:26Z,use_quota=True,user_id='b868a01245794b75bc68b96c4e238ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Creating volume 16284c0d-0ff3-403a-8dce-e3fb54780c3e {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:25:28 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:25:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:25:28 devstack quobyte-client[83627]: System call of process 84295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:25:29 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=2, name=volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:25:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e 1073741824" returned: 0 in 1.596s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:25:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e" returned: 0 in 0.276s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] <== create_volume: return (2067ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167588e0-44ed-4be1-b032-2b6729676821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6830d67b-f672-47a6-9fc5-26704294d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e (16284c0d-0ff3-403a-8dce-e3fb54780c3e): created successfully Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6830d67b-f672-47a6-9fc5-26704294d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Flow 'volume_create_manager' (27cd33b8-cbc0-48b9-8ffb-895a10d7cce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:25:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-5d32d3cc-500c-4090-944b-729adaba49e9 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Created volume successfully. Sep 26 17:25:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:25:34 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:25:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Flow 'volume_create_manager' (3d8e9777-e632-454a-9116-a4305ae4f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:25:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dce4e3-0463-40c8-a3a2-12967e77ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dce4e3-0463-40c8-a3a2-12967e77ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51646208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5482394-cc0d-4880-a5c5-3507b40ef9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf6959b374448efa0a0d6404ec851ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:25:34Z,use_quota=True,user_id='07c42b2e66b6471bbf31c6ca79341089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83041156-5dbd-4b94-b71e-9326f89eadd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83041156-5dbd-4b94-b71e-9326f89eadd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cf4bf-77de-412a-9d68-4fd1a29817cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cf4bf-77de-412a-9d68-4fd1a29817cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5482394-cc0d-4880-a5c5-3507b40ef9a9', 'volume_name': 'volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475695fa-caf2-460d-a112-bd84ca7f55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475695fa-caf2-460d-a112-bd84ca7f55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b273b8-943c-4f8b-9b4e-4925434abc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Volume f5482394-cc0d-4880-a5c5-3507b40ef9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9', 'volume_size': 1} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51646208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5482394-cc0d-4880-a5c5-3507b40ef9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf6959b374448efa0a0d6404ec851ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:25:34Z,use_quota=True,user_id='07c42b2e66b6471bbf31c6ca79341089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Creating volume f5482394-cc0d-4880-a5c5-3507b40ef9a9 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:25:35 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:25:35 devstack quobyte-client[83627]: System call of process 84631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:25:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=3, name=volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 1073741824" returned: 0 in 0.616s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:25:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:25:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9" returned: 0 in 0.195s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:25:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] <== create_volume: return (1217ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:25:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:25:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b273b8-943c-4f8b-9b4e-4925434abc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d7f50e-3a60-4cac-be76-7b83a2cb2bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:25:37 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Volume volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 (f5482394-cc0d-4880-a5c5-3507b40ef9a9): created successfully Sep 26 17:25:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d7f50e-3a60-4cac-be76-7b83a2cb2bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:25:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Flow 'volume_create_manager' (3d8e9777-e632-454a-9116-a4305ae4f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:25:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-80748ea9-a8a1-4580-90ce-9e987d0dac22 tempest-DeleteServersTestJSON-2140390209 None] Created volume successfully. Sep 26 17:25:47 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:25:47 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=4,cinder:DELETE=2,cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.186s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:26:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:26:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:26:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.079s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:26:13 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr5w67b37/privsep.sock'] Sep 26 17:26:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 4.647s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:26:14 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:26:14 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr5w67b37/privsep.sock Sep 26 17:26:14 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:26:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:26:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:26:27 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Sep 26 17:26:27 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Spawned new privsep daemon via rootwrap Sep 26 17:26:27 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Accepted privsep connection to /tmp/tmpr5w67b37/privsep.sock {{(pid=83624) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 26 17:26:27 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 26 17:26:27 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 26 17:26:27 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 26 17:26:27 devstack cinder-volume[83624]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84946 Sep 26 17:26:27 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68bb09e-026d-4c54-bfc4-1e5c7b919062]: (2,) {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:26:27 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d90ef-d645-4177-be86-f185d58eb145]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:26:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:26:28 devstack quobyte-client[83627]: System call of process 84963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:26:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9" returned: 0 in 1.021s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:26:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 15.572s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:26:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd09296a-871b-481d-9890-3e6375599113', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:26:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:26:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-54e099ae-bf94-4722-8097-2d7c53832884 req-592f6aa4-2e8b-454c-b1df-d926f8018f84 tempest-DeleteServersTestJSON-2140390209 None] attachment_update completed successfully. Sep 26 17:26:40 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:26:40 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:26:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-6b82c667-3811-45c4-b1bb-4e650515f5d6 req-0e99d4d2-f67a-4f2b-ba92-b6739d188be2 tempest-DeleteServersTestJSON-2140390209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:26:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-6b82c667-3811-45c4-b1bb-4e650515f5d6 req-0e99d4d2-f67a-4f2b-ba92-b6739d188be2 tempest-DeleteServersTestJSON-2140390209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:26:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-6b82c667-3811-45c4-b1bb-4e650515f5d6 req-0e99d4d2-f67a-4f2b-ba92-b6739d188be2 tempest-DeleteServersTestJSON-2140390209 None] Terminate volume connection completed successfully. Sep 26 17:26:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-6b82c667-3811-45c4-b1bb-4e650515f5d6 req-0e99d4d2-f67a-4f2b-ba92-b6739d188be2 tempest-DeleteServersTestJSON-2140390209 None] Deleting attachment fd09296a-871b-481d-9890-3e6375599113. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:26:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "cinder-f5482394-cc0d-4880-a5c5-3507b40ef9a9-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:26:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "cinder-f5482394-cc0d-4880-a5c5-3507b40ef9a9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:26:54 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:26:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "cinder-quobyte-f5482394-cc0d-4880-a5c5-3507b40ef9a9" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:26:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "cinder-quobyte-f5482394-cc0d-4880-a5c5-3507b40ef9a9" acquired by "delete_volume" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170742e-f506-477d-96b3-61959e814d45]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:26:55 devstack quobyte-client[83627]: System call of process 85566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9" returned: 0 in 0.437s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f5482394-cc0d-4880-a5c5-3507b40ef9a9" returned: 0 in 0.181s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:26:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "cinder-quobyte-f5482394-cc0d-4880-a5c5-3507b40ef9a9" released by "delete_volume" :: held 0.823s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:26:56 devstack cinder-volume[83624]: WARNING cinder.quota [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:26:56 devstack cinder-volume[83624]: WARNING cinder.quota [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Created reservations ['cca63550-df9c-444a-9ca4-792f979bd3dd', '9159ac79-0260-4ab0-8476-fe716f786527', '30d98fde-b56a-479d-bb8c-22603c879fa4', '877df4a5-f136-46a1-9477-1e5e6d04c270'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.104s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:26:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Deleted volume successfully. Sep 26 17:26:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6f427a67-4ba2-4dc0-a653-98f85bf62b7d tempest-DeleteServersTestJSON-2140390209 None] Lock "cinder-f5482394-cc0d-4880-a5c5-3507b40ef9a9-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:27:06 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:27:06 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.335s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:27:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Flow 'volume_create_manager' (e5bee629-5b12-41f6-8569-f773dc370926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ab0328-bb86-48d4-a558-ec8f75bcdfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ab0328-bb86-48d4-a558-ec8f75bcdfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-39456364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03051cef-73c4-42ad-90c8-cd4965fd164e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4763726eae2456486dae49ba0786da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:16Z,use_quota=True,user_id='fe9cff670efd406a932a5090a4f04b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d435b-63a5-4ac9-910e-35521f92cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d435b-63a5-4ac9-910e-35521f92cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df523771-e6a3-4e06-a2e9-d58e02e06720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df523771-e6a3-4e06-a2e9-d58e02e06720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03051cef-73c4-42ad-90c8-cd4965fd164e', 'volume_name': 'volume-03051cef-73c4-42ad-90c8-cd4965fd164e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f6f78-2273-4468-81d5-a13f7732cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f6f78-2273-4468-81d5-a13f7732cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c83b76-3181-4687-82df-a063464dfe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:16 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume 03051cef-73c4-42ad-90c8-cd4965fd164e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03051cef-73c4-42ad-90c8-cd4965fd164e', 'volume_size': 1} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-39456364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03051cef-73c4-42ad-90c8-cd4965fd164e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4763726eae2456486dae49ba0786da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:16Z,use_quota=True,user_id='fe9cff670efd406a932a5090a4f04b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Creating volume 03051cef-73c4-42ad-90c8-cd4965fd164e {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:27:16 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:27:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:16 devstack quobyte-client[83627]: System call of process 85620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=4, name=volume-03051cef-73c4-42ad-90c8-cd4965fd164e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e 1073741824" returned: 0 in 0.422s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] <== create_volume: return (603ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c83b76-3181-4687-82df-a063464dfe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03051cef-73c4-42ad-90c8-cd4965fd164e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b1499a-c70f-4c70-8a4d-17a269e5e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:17 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume volume-03051cef-73c4-42ad-90c8-cd4965fd164e (03051cef-73c4-42ad-90c8-cd4965fd164e): created successfully Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b1499a-c70f-4c70-8a4d-17a269e5e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Flow 'volume_create_manager' (e5bee629-5b12-41f6-8569-f773dc370926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-610f716e-d440-4bd3-b2bd-9267addebc66 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Created volume successfully. Sep 26 17:27:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf09a9-873b-4b24-9d47-487d087357c1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e" returned: 0 in 0.530s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-03051cef-73c4-42ad-90c8-cd4965fd164e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e25a8f1-7f26-4bfc-890f-0c971b62549a', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:27:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-ce8152db-f722-4b4d-b7eb-26251f73c964 req-f7f04ca3-4e78-4e2e-8afe-e44310ba4cb9 tempest-AttachSCSIVolumeTestJSON-2046616783 None] attachment_update completed successfully. Sep 26 17:27:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (14c90b05-a472-44a1-a6d2-be4444c50424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be5751d-776c-44a1-982c-87f1058f544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be5751d-776c-44a1-982c-87f1058f544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-293998862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3cb972-580a-4a73-aecb-51f06fba3824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:33Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc96be5-3912-4b7a-bc39-4294cab60cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc96be5-3912-4b7a-bc39-4294cab60cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed52bf-d6ba-465e-9b92-4a106eb61ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed52bf-d6ba-465e-9b92-4a106eb61ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be3cb972-580a-4a73-aecb-51f06fba3824', 'volume_name': 'volume-be3cb972-580a-4a73-aecb-51f06fba3824', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51bdf50-e273-4029-8225-8a131261fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51bdf50-e273-4029-8225-8a131261fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6604117a-6917-4435-a81a-3b5b1687b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Volume be3cb972-580a-4a73-aecb-51f06fba3824: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be3cb972-580a-4a73-aecb-51f06fba3824', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 26 17:27:33 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Cloning be3cb972-580a-4a73-aecb-51f06fba3824 from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 17:27:34 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 17:27:34 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Image download 20.69 MB at 20.69 MB/s Sep 26 17:27:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da667de-92e7-4f74-8e46-ad9a123f5437]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:35 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD Sep 26 17:27:35 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:27:37 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Sep 26 17:27:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD" returned: 0 in 2.673s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:37 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 is fetched for user f89f258fce8b424aa2dbce63c78fa3b7. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 17:27:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341e0f2-3bf0-4ed1-9220-d2b3fed723f9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:38 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD Sep 26 17:27:38 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:27:40 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD" returned: 0 in 2.072s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-293998862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3cb972-580a-4a73-aecb-51f06fba3824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:33Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Creating volume be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:27:40 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:40 devstack quobyte-client[83627]: System call of process 86090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:40 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=5, name=volume-be3cb972-580a-4a73-aecb-51f06fba3824, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 1073741824" returned: 0 in 0.325s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 0.105s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.542s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Attempting download of b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume be3cb972-580a-4a73-aecb-51f06fba3824. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f27e2-d68c-44fa-96ab-b4afb6afb85c]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_duoeq38i {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_duoeq38i" returned: 0 in 0.460s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_duoeq38i {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_duoeq38i" returned: 1 in 0.417s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_duoeq38i' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc024a14-f92b-4225-9b53-6b7a75bf1a79]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:42 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] b453c7ff-249a-4559-a968-e9bd0fbe8a12 was qcow2, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 17:27:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:42 devstack quobyte-client[83627]: System call of process 86108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:42 devstack quobyte-client[83627]: System call of process 86108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:42 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=5, name=volume-be3cb972-580a-4a73-aecb-51f06fba3824, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 1.027s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12__ovanwf6devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:27:43 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Converted 112.00 MB image at 105.49 MB/s Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:43 devstack quobyte-client[83627]: System call of process 86114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:43 devstack quobyte-client[83627]: System call of process 86114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:43 devstack quobyte-client[83627]: System call of process 86114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 1G" returned: 0 in 0.162s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[273ff8ff-6dc3-4157-aa44-a7457927e5e2]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 0.343s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 1 in 0.500s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Downloaded image b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume be3cb972-580a-4a73-aecb-51f06fba3824 successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 for user f89f258fce8b424aa2dbce63c78fa3b7 is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 17:27:44 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Marking volume be3cb972-580a-4a73-aecb-51f06fba3824 as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Copying metadata from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 to be3cb972-580a-4a73-aecb-51f06fba3824. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Creating volume glance metadata for volume be3cb972-580a-4a73-aecb-51f06fba3824 backed by image b453c7ff-249a-4559-a968-e9bd0fbe8a12 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6604117a-6917-4435-a81a-3b5b1687b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3cb972-580a-4a73-aecb-51f06fba3824', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ce74a2-71b9-405e-a6c4-a6875357b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Volume volume-be3cb972-580a-4a73-aecb-51f06fba3824 (be3cb972-580a-4a73-aecb-51f06fba3824): created successfully Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ce74a2-71b9-405e-a6c4-a6875357b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (14c90b05-a472-44a1-a6d2-be4444c50424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-181d2309-d26d-4f62-a3e9-6c40ef861707 tempest-TaggedBootDevicesTest-2006547004 None] Created volume successfully. Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608531d-df2b-4eee-95aa-643787805426]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e" returned: 0 in 0.426s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.484s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '005fde25-8bd7-4824-a39f-f39b7641e03c', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:27:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-d46122a7-387f-4085-acb9-643b58befe15 req-cb8adc90-47bf-450f-a271-a4bfe5503a6e tempest-VolumesAssistedSnapshotsTest-2094641177 None] attachment_update completed successfully. Sep 26 17:27:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (1508f40c-4fd8-463c-8f4c-669d6a4f1f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97147aca-7f4e-45ea-9bac-1c5b2b169085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97147aca-7f4e-45ea-9bac-1c5b2b169085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-668224697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ca0e1-d01b-4cbb-8958-149ce3b7522f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:46Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9ff1c-7526-4fa4-b2ba-6d28ca4e962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9ff1c-7526-4fa4-b2ba-6d28ca4e962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993f0c0e-7343-4943-9533-3db206261e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993f0c0e-7343-4943-9533-3db206261e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671ca0e1-d01b-4cbb-8958-149ce3b7522f', 'volume_name': 'volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841b1754-b111-4dba-891e-7ad68ecd2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841b1754-b111-4dba-891e-7ad68ecd2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4c55a9-dd7b-40b2-aaa8-bbdee3d0231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:46 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Volume 671ca0e1-d01b-4cbb-8958-149ce3b7522f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f', 'volume_size': 1} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-668224697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ca0e1-d01b-4cbb-8958-149ce3b7522f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:46Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Creating volume 671ca0e1-d01b-4cbb-8958-149ce3b7522f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:27:46 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:27:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:47 devstack quobyte-client[83627]: System call of process 86188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:27:47 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=6, name=volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f 1073741824" returned: 0 in 0.434s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] <== create_volume: return (629ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4c55a9-dd7b-40b2-aaa8-bbdee3d0231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daec8623-70c6-42e0-8a28-3c25937a3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:47 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Volume volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f (671ca0e1-d01b-4cbb-8958-149ce3b7522f): created successfully Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daec8623-70c6-42e0-8a28-3c25937a3b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (1508f40c-4fd8-463c-8f4c-669d6a4f1f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-996f390b-e089-42fa-aaad-751840c3d443 tempest-TaggedBootDevicesTest-2006547004 None] Created volume successfully. Sep 26 17:27:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (b0078b88-8872-41e3-a0d0-cee82f669acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5b45ab-6c03-4a78-8959-2ec3769ab8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5b45ab-6c03-4a78-8959-2ec3769ab8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-211511259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849df3cd-1eca-4ace-9e8c-df379f834d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:49Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648c2ef4-71df-4e34-9e1f-a2cfe0f41d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648c2ef4-71df-4e34-9e1f-a2cfe0f41d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8bf216-2ae0-4497-82f8-3b91dd84ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8bf216-2ae0-4497-82f8-3b91dd84ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849df3cd-1eca-4ace-9e8c-df379f834d6f', 'volume_name': 'volume-849df3cd-1eca-4ace-9e8c-df379f834d6f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcb8773-21b4-4b43-b77d-18a8d8882044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcb8773-21b4-4b43-b77d-18a8d8882044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00077618-a1cd-4e34-9b2c-984d7614ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:49 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Volume 849df3cd-1eca-4ace-9e8c-df379f834d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849df3cd-1eca-4ace-9e8c-df379f834d6f', 'volume_size': 1} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-211511259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849df3cd-1eca-4ace-9e8c-df379f834d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8face405c341e78e51cdb0c4880742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:27:49Z,use_quota=True,user_id='f89f258fce8b424aa2dbce63c78fa3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Creating volume 849df3cd-1eca-4ace-9e8c-df379f834d6f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:27:49 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:49 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=7, name=volume-849df3cd-1eca-4ace-9e8c-df379f834d6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f 1073741824" returned: 0 in 0.330s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] <== create_volume: return (497ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:27:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:27:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00077618-a1cd-4e34-9b2c-984d7614ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849df3cd-1eca-4ace-9e8c-df379f834d6f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2c9e8e-ce4e-48b6-adee-168393d61024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:27:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Volume volume-849df3cd-1eca-4ace-9e8c-df379f834d6f (849df3cd-1eca-4ace-9e8c-df379f834d6f): created successfully Sep 26 17:27:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2c9e8e-ce4e-48b6-adee-168393d61024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:27:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Flow 'volume_create_manager' (b0078b88-8872-41e3-a0d0-cee82f669acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:27:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7852b35c-2517-44f7-9979-7b859fbb8dca tempest-TaggedBootDevicesTest-2006547004 None] Created volume successfully. Sep 26 17:27:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-007c9bf1-c65a-4d64-b869-b2fb4ed82352 req-a185b81c-0bda-4dc5-a093-c0405b2be1dd tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-007c9bf1-c65a-4d64-b869-b2fb4ed82352 req-a185b81c-0bda-4dc5-a093-c0405b2be1dd tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:27:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-007c9bf1-c65a-4d64-b869-b2fb4ed82352 req-a185b81c-0bda-4dc5-a093-c0405b2be1dd tempest-AttachSCSIVolumeTestJSON-2046616783 None] Terminate volume connection completed successfully. Sep 26 17:27:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-007c9bf1-c65a-4d64-b869-b2fb4ed82352 req-a185b81c-0bda-4dc5-a093-c0405b2be1dd tempest-AttachSCSIVolumeTestJSON-2046616783 None] Deleting attachment 8e25a8f1-7f26-4bfc-890f-0c971b62549a. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:28:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:28:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=26,cinder:UPDATE=14,cinder:INSERT=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "cinder-03051cef-73c4-42ad-90c8-cd4965fd164e-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "cinder-03051cef-73c4-42ad-90c8-cd4965fd164e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:28:07 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "cinder-quobyte-03051cef-73c4-42ad-90c8-cd4965fd164e" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "cinder-quobyte-03051cef-73c4-42ad-90c8-cd4965fd164e" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b4cd9-6734-46d1-9a6a-1a23aef0d484]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:28:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e" returned: 0 in 0.409s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-03051cef-73c4-42ad-90c8-cd4965fd164e" returned: 0 in 0.104s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "cinder-quobyte-03051cef-73c4-42ad-90c8-cd4965fd164e" released by "delete_volume" :: held 0.644s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Created reservations ['fabadc2e-318f-44b8-a21f-9a538a8cef79', 'ff7e2447-343f-4293-a825-65a6552a0d82', 'd637f85a-d0b1-4b87-8079-faa5861f0630', 'c15a730a-77a5-4d0b-a6a3-090f90c0b9bc'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:28:09 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Deleted volume successfully. Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.325s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:28:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2f42ba9-efcc-48d8-9949-86ed59818f98 tempest-AttachSCSIVolumeTestJSON-2046616783 None] Lock "cinder-03051cef-73c4-42ad-90c8-cd4965fd164e-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:28:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:15 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[85762682-c5ba-4fca-b3e9-90a273db6188]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:28:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-a4d6c1cb-ea5c-49d1-a132-17a914ad9d80 req-74c81b43-5d71-4c04-9621-7b030ac48b22 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-a4d6c1cb-ea5c-49d1-a132-17a914ad9d80 req-74c81b43-5d71-4c04-9621-7b030ac48b22 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-a4d6c1cb-ea5c-49d1-a132-17a914ad9d80 req-74c81b43-5d71-4c04-9621-7b030ac48b22 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Terminate volume connection completed successfully. Sep 26 17:28:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-a4d6c1cb-ea5c-49d1-a132-17a914ad9d80 req-74c81b43-5d71-4c04-9621-7b030ac48b22 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Deleting attachment 005fde25-8bd7-4824-a39f-f39b7641e03c. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:28:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 0.932s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 1 in 0.588s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:28:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.725s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-be3cb972-580a-4a73-aecb-51f06fba3824', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3471532b-3908-47cf-8f14-4ff3ecca32b7', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:28:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "cinder-16284c0d-0ff3-403a-8dce-e3fb54780c3e-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "cinder-16284c0d-0ff3-403a-8dce-e3fb54780c3e-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:28:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-d1aca5bd-ca90-4185-87a8-73f2ebce8ced tempest-TaggedBootDevicesTest-2006547004 None] attachment_update completed successfully. Sep 26 17:28:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "cinder-quobyte-16284c0d-0ff3-403a-8dce-e3fb54780c3e" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "cinder-quobyte-16284c0d-0ff3-403a-8dce-e3fb54780c3e" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb45ef-f60b-42b9-9c39-ad9295c0d7de]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e" returned: 0 in 0.556s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-16284c0d-0ff3-403a-8dce-e3fb54780c3e" returned: 0 in 0.136s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "cinder-quobyte-16284c0d-0ff3-403a-8dce-e3fb54780c3e" released by "delete_volume" :: held 0.940s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Created reservations ['5c0d402c-8aec-410f-b3b4-6d096a5e2956', '5efca7b3-ac4a-485e-855e-fff274113542', 'b83b292a-ce62-4771-9ef1-062129d4cc58', 'eb941e16-7695-4153-9415-e19d37237c29'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.163s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:20 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:28:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Deleted volume successfully. Sep 26 17:28:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-38c5eb46-db9a-48c9-bfd4-6f1d76c3c637 tempest-VolumesAssistedSnapshotsTest-2094641177 None] Lock "cinder-16284c0d-0ff3-403a-8dce-e3fb54780c3e-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:28:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23018b-f437-492e-8a68-3e241ad78fcd]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:28:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:22 devstack quobyte-client[83627]: System call of process 86340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:28:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f" returned: 0 in 0.620s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.714s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '279c5de7-e331-483d-b4fe-6215fe45c95d', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:28:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-1686690d-c46c-4508-840a-8e84c83e32c0 tempest-TaggedBootDevicesTest-2006547004 None] attachment_update completed successfully. Sep 26 17:28:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:28:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:28:26 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b640518-407c-43c4-9410-522705b9fec7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:28:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:28:27 devstack quobyte-client[83627]: System call of process 86397 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:28:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f" returned: 0 in 0.610s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:28:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.679s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:28:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-849df3cd-1eca-4ace-9e8c-df379f834d6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32e7a62c-6579-4fa0-ab32-6d12c19d1350', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:28:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:28:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-5867e41d-f7bd-4e45-ab34-00558e229929 req-c4fed969-00f1-4e63-9e73-1430940b48aa tempest-TaggedBootDevicesTest-2006547004 None] attachment_update completed successfully. Sep 26 17:28:38 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:28:38 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.129s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:29:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:29:56 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Flow 'volume_create_manager' (71aaa9bd-9e35-4b21-88a4-f36b3987b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ce6064-16b5-4c61-8949-058f35b1994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ce6064-16b5-4c61-8949-058f35b1994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-447472962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17eeb909-53ac-45e6-9ec5-3292022ca3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01724e274e0540279098293ec5453e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:29:56Z,use_quota=True,user_id='e44789441b8d4db3a4f945f64232913b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426efac3-a41c-4b4c-a1b7-786bb5050ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426efac3-a41c-4b4c-a1b7-786bb5050ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa2a06b-c1b9-40fa-9c19-3a4faebab339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa2a06b-c1b9-40fa-9c19-3a4faebab339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17eeb909-53ac-45e6-9ec5-3292022ca3eb', 'volume_name': 'volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f063a99b-5d03-4f1d-b605-89d485cb8218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f063a99b-5d03-4f1d-b605-89d485cb8218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c877fb0-9b4a-430a-92b2-3bc2b29b2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:56 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Volume 17eeb909-53ac-45e6-9ec5-3292022ca3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb', 'volume_size': 1} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-447472962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17eeb909-53ac-45e6-9ec5-3292022ca3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01724e274e0540279098293ec5453e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:29:56Z,use_quota=True,user_id='e44789441b8d4db3a4f945f64232913b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Creating volume 17eeb909-53ac-45e6-9ec5-3292022ca3eb {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:29:56 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:29:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:29:57 devstack quobyte-client[83627]: System call of process 87379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:29:57 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=8, name=volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb 1073741824" returned: 0 in 0.374s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb" returned: 0 in 0.137s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] <== create_volume: return (618ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c877fb0-9b4a-430a-92b2-3bc2b29b2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de37fc6-bddc-4638-a841-0b05a3cad914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:29:57 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Volume volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb (17eeb909-53ac-45e6-9ec5-3292022ca3eb): created successfully Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de37fc6-bddc-4638-a841-0b05a3cad914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:29:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Flow 'volume_create_manager' (71aaa9bd-9e35-4b21-88a4-f36b3987b29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:29:57 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-103397e2-d369-4e21-8a1f-e93b277afa9a tempest-TaggedAttachmentsTest-1227835558 None] Created volume successfully. Sep 26 17:30:07 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:30:07 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:30:19 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Flow 'volume_create_manager' (adbd3867-e66a-4815-99b3-1a503e6ed082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f486965b-3515-4cde-9ee5-2eb66a6b8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f486965b-3515-4cde-9ee5-2eb66a6b8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-299136314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c86715-0fca-4fc8-b0bd-358a3aff325f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab63b33fd494ae18f8ef2719e4b1e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:30:19Z,use_quota=True,user_id='14c2edbea6374a7f8349a417e553ad2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39911ab-bccc-4a17-83b5-3e7960facead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39911ab-bccc-4a17-83b5-3e7960facead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2242256c-4adb-4d83-b0a7-634487800767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2242256c-4adb-4d83-b0a7-634487800767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c86715-0fca-4fc8-b0bd-358a3aff325f', 'volume_name': 'volume-47c86715-0fca-4fc8-b0bd-358a3aff325f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86f583b-f6cc-4d0c-9b06-27b90fc1e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86f583b-f6cc-4d0c-9b06-27b90fc1e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a5fc17-ef19-4c66-a68a-329c1126d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:19 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Volume 47c86715-0fca-4fc8-b0bd-358a3aff325f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c86715-0fca-4fc8-b0bd-358a3aff325f', 'volume_size': 1} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-299136314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c86715-0fca-4fc8-b0bd-358a3aff325f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab63b33fd494ae18f8ef2719e4b1e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:30:19Z,use_quota=True,user_id='14c2edbea6374a7f8349a417e553ad2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Creating volume 47c86715-0fca-4fc8-b0bd-358a3aff325f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:30:19 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:30:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:30:19 devstack quobyte-client[83627]: System call of process 87487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:30:19 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=9, name=volume-47c86715-0fca-4fc8-b0bd-358a3aff325f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f 1073741824" returned: 0 in 0.566s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f" returned: 0 in 0.206s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] <== create_volume: return (935ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a5fc17-ef19-4c66-a68a-329c1126d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c86715-0fca-4fc8-b0bd-358a3aff325f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f300afa5-2216-450a-9f14-e0a04f551b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:30:20 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Volume volume-47c86715-0fca-4fc8-b0bd-358a3aff325f (47c86715-0fca-4fc8-b0bd-358a3aff325f): created successfully Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f300afa5-2216-450a-9f14-e0a04f551b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:30:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Flow 'volume_create_manager' (adbd3867-e66a-4815-99b3-1a503e6ed082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:30:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-38fef64b-cb04-4d40-8195-ea2f9ecec71c tempest-VolumesAdminNegativeTest-52703043 None] Created volume successfully. Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Acquiring lock "cinder-47c86715-0fca-4fc8-b0bd-358a3aff325f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "cinder-47c86715-0fca-4fc8-b0bd-358a3aff325f-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:30:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Acquiring lock "cinder-quobyte-47c86715-0fca-4fc8-b0bd-358a3aff325f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "cinder-quobyte-47c86715-0fca-4fc8-b0bd-358a3aff325f" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b21bd2-6b67-4410-a384-ddab27e755e3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:30:22 devstack quobyte-client[83627]: System call of process 87507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f" returned: 0 in 0.436s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:30:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-47c86715-0fca-4fc8-b0bd-358a3aff325f" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "cinder-quobyte-47c86715-0fca-4fc8-b0bd-358a3aff325f" released by "delete_volume" :: held 0.718s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Created reservations ['7bc9fb32-8605-4988-9ed5-0eb8324fefac', '03bfe0e7-2b20-41d8-9f59-5c6ccf709b11', 'fe5b4ec0-19ae-4101-a7d9-c45d75471c38', '3b7f932c-e8be-4d59-8b31-05864087353f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:30:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Deleted volume successfully. Sep 26 17:30:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2933f6b6-46d0-4bde-964c-ccf5ed210079 tempest-VolumesAdminNegativeTest-52703043 None] Lock "cinder-47c86715-0fca-4fc8-b0bd-358a3aff325f-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:30:33 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:30:33 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.205s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:31:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:31:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-2599611b-bf3d-43fb-a47d-0e09a680b89f tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-2599611b-bf3d-43fb-a47d-0e09a680b89f tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-2599611b-bf3d-43fb-a47d-0e09a680b89f tempest-TaggedBootDevicesTest-2006547004 None] Terminate volume connection completed successfully. Sep 26 17:31:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-2599611b-bf3d-43fb-a47d-0e09a680b89f tempest-TaggedBootDevicesTest-2006547004 None] Deleting attachment 3471532b-3908-47cf-8f14-4ff3ecca32b7. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:31:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-3b84c77a-7897-4001-9b92-400e58b2407d tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-3b84c77a-7897-4001-9b92-400e58b2407d tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-3b84c77a-7897-4001-9b92-400e58b2407d tempest-TaggedBootDevicesTest-2006547004 None] Terminate volume connection completed successfully. Sep 26 17:31:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-3b84c77a-7897-4001-9b92-400e58b2407d tempest-TaggedBootDevicesTest-2006547004 None] Deleting attachment 279c5de7-e331-483d-b4fe-6215fe45c95d. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:31:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-d5aff5b4-6bbc-43d4-9f25-6f0f9916b163 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-d5aff5b4-6bbc-43d4-9f25-6f0f9916b163 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-d5aff5b4-6bbc-43d4-9f25-6f0f9916b163 tempest-TaggedBootDevicesTest-2006547004 None] Terminate volume connection completed successfully. Sep 26 17:31:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-fad7f5a6-ead7-47ed-9ed1-49e4d54c511b req-d5aff5b4-6bbc-43d4-9f25-6f0f9916b163 tempest-TaggedBootDevicesTest-2006547004 None] Deleting attachment 32e7a62c-6579-4fa0-ab32-6d12c19d1350. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:31:57 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=4 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-849df3cd-1eca-4ace-9e8c-df379f834d6f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-849df3cd-1eca-4ace-9e8c-df379f834d6f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:31:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-quobyte-849df3cd-1eca-4ace-9e8c-df379f834d6f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-849df3cd-1eca-4ace-9e8c-df379f834d6f" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eeb422-5b71-4c33-85f9-ac0acfb9131f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:31:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f" returned: 0 in 0.531s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-849df3cd-1eca-4ace-9e8c-df379f834d6f" returned: 0 in 0.110s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-849df3cd-1eca-4ace-9e8c-df379f834d6f" released by "delete_volume" :: held 0.821s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Created reservations ['d139bf80-fff0-4b82-9bd6-846b738d6af7', '730f8134-23c6-449f-85de-7fe96743a22b', '5dc56b34-7fe0-4f62-914c-7a3b22a35bbd', '3277a141-69b1-45a8-923c-fa53908712a3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:31:59 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:31:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Deleted volume successfully. Sep 26 17:32:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa85ab14-7aa8-4257-a085-f06f3bd94572 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-849df3cd-1eca-4ace-9e8c-df379f834d6f-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-671ca0e1-d01b-4cbb-8958-149ce3b7522f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-671ca0e1-d01b-4cbb-8958-149ce3b7522f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-quobyte-671ca0e1-d01b-4cbb-8958-149ce3b7522f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-671ca0e1-d01b-4cbb-8958-149ce3b7522f" acquired by "delete_volume" :: waited 0.077s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c338f6-0501-49cb-bac4-4e567508e3f0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:04 devstack quobyte-client[83627]: System call of process 88278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:04 devstack quobyte-client[83627]: System call of process 88278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f" returned: 0 in 2.660s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-671ca0e1-d01b-4cbb-8958-149ce3b7522f" returned: 0 in 0.374s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-671ca0e1-d01b-4cbb-8958-149ce3b7522f" released by "delete_volume" :: held 3.551s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Created reservations ['5f4b9a25-d7a4-4873-a580-a1776e53cebf', 'face8ef9-077f-49d0-a454-fba2eab81142', '76d0d248-1094-4064-acb9-767a83e485ac', 'b7039bb8-0207-4f53-a3ec-8c8acd6ecb7e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.200s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:06 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:32:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Deleted volume successfully. Sep 26 17:32:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1af4605a-c915-421f-94dc-8808fb684fe2 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-671ca0e1-d01b-4cbb-8958-149ce3b7522f-delete_volume" released by "delete_volume" :: held 5.612s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-be3cb972-580a-4a73-aecb-51f06fba3824-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-be3cb972-580a-4a73-aecb-51f06fba3824-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:07 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "cinder-quobyte-be3cb972-580a-4a73-aecb-51f06fba3824" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-be3cb972-580a-4a73-aecb-51f06fba3824" acquired by "delete_volume" :: waited 0.041s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b22b8be-c165-4ef6-a1f7-f81b2082b0e0]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 0.547s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:08 devstack quobyte-client[83627]: System call of process 88354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 1 in 0.990s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.120s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-be3cb972-580a-4a73-aecb-51f06fba3824" returned: 0 in 0.558s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-quobyte-be3cb972-580a-4a73-aecb-51f06fba3824" released by "delete_volume" :: held 2.488s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.659s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Created reservations ['2e90d586-b440-41a5-ac0d-355a5a852e5a', '2301d223-2955-40d7-9c29-239752f070c6', '4d81e31c-3e50-4576-bbdb-e19a279ba2ee', 'e3111a6e-200c-4109-b1d8-47efff7eb5ec'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.275s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:32:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Deleted volume successfully. Sep 26 17:32:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca29a37e-8069-4b75-90c8-72de55fcd813 tempest-TaggedBootDevicesTest-2006547004 None] Lock "cinder-be3cb972-580a-4a73-aecb-51f06fba3824-delete_volume" released by "delete_volume" :: held 5.128s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7d610-a9d5-4e14-ac3c-4bc2b0e42859]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb" returned: 0 in 0.905s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23ffae80-f3ee-43ae-b7f4-c9dee89a110e', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:32:14 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-36e2ad45-6433-4bdc-b6ff-29b4fe33f0f1 req-e13a3941-cadd-4f3e-bd6e-bcb95ce707d6 tempest-TaggedAttachmentsTest-1227835558 None] attachment_update completed successfully. Sep 26 17:32:25 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:32:25 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:32:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-92b62fb1-8918-4828-b6db-c703b722d78a tempest-GroupSnapshotsV319Test-601723024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-92b62fb1-8918-4828-b6db-c703b722d78a tempest-GroupSnapshotsV319Test-601723024 None] Group tempest-GroupSnapshotsV319Test-Group-471600140: creating Sep 26 17:32:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-92b62fb1-8918-4828-b6db-c703b722d78a tempest-GroupSnapshotsV319Test-601723024 None] Group tempest-GroupSnapshotsV319Test-Group-471600140: created successfully Sep 26 17:32:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-92b62fb1-8918-4828-b6db-c703b722d78a tempest-GroupSnapshotsV319Test-601723024 None] Create group completed successfully. Sep 26 17:32:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Flow 'volume_create_manager' (7a967b80-334d-4610-8bcc-05542621006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639804c7-6d41-4672-be0f-ce43ee6d285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639804c7-6d41-4672-be0f-ce43ee6d285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-961883422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abcff26f-0596-4ce3-8d59-623c8f43a6ba,host='devstack@QuobyteHD#QuobyteHD',id=2e7d595d-3413-4c70-84bc-c4eec54d1e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21345449e734d28b3244e2f719da3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:32:36Z,use_quota=True,user_id='476f4bfda77246be9e1a5227f3b7cc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d8405f3-4945-43d7-ab51-b48bb3680be4),volume_type_id=7d8405f3-4945-43d7-ab51-b48bb3680be4)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f2737-12e1-4c19-bc87-1b551e66b398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f2737-12e1-4c19-bc87-1b551e66b398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720f0221-1beb-4870-803f-9e339aaaa9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720f0221-1beb-4870-803f-9e339aaaa9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7d595d-3413-4c70-84bc-c4eec54d1e34', 'volume_name': 'volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b0f8ca-c5c4-4b4a-af6f-6b1010998ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b0f8ca-c5c4-4b4a-af6f-6b1010998ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d09ae-ad75-4722-b0d8-0e32d59f5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Volume 2e7d595d-3413-4c70-84bc-c4eec54d1e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34', 'volume_size': 1} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abcff26f-0596-4ce3-8d59-623c8f43a6ba,created_at=2025-09-26T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-961883422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abcff26f-0596-4ce3-8d59-623c8f43a6ba,host='devstack@QuobyteHD#QuobyteHD',id=2e7d595d-3413-4c70-84bc-c4eec54d1e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21345449e734d28b3244e2f719da3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:32:36Z,use_quota=True,user_id='476f4bfda77246be9e1a5227f3b7cc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d8405f3-4945-43d7-ab51-b48bb3680be4),volume_type_id=7d8405f3-4945-43d7-ab51-b48bb3680be4)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Creating volume 2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:32:35 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:32:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=10, name=volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 1073741824" returned: 0 in 0.369s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34" returned: 0 in 0.279s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d09ae-ad75-4722-b0d8-0e32d59f5c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a589b5-dbfe-47c1-9604-f6f08712e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Volume volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 (2e7d595d-3413-4c70-84bc-c4eec54d1e34): created successfully Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a589b5-dbfe-47c1-9604-f6f08712e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Flow 'volume_create_manager' (7a967b80-334d-4610-8bcc-05542621006c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:32:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8ef82c8f-c6b0-46be-ad0c-a4b4439dd08c tempest-GroupSnapshotsV319Test-601723024 None] Created volume successfully. Sep 26 17:32:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] GroupSnapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: creating. Sep 26 17:32:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Group snapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: creating. {{(pid=83624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Creating offline snapshot 719e5522-16e6-41d5-bbe2-c88604b94d30 of volume 2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f9eac4-9610-4aa4-ba9f-1b8b6c6cd5fb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:39 devstack quobyte-client[83627]: System call of process 88871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:39 devstack quobyte-client[83627]: System call of process 88871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:39 devstack quobyte-client[83627]: System call of process 88871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:39 devstack quobyte-client[83627]: System call of process 88871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34" returned: 0 in 0.642s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:39 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=11, name=volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:32:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 1G" returned: 0 in 0.414s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "qemu-img rebase -u -b volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.095s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.152s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.info" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.info" returned: 0 in 0.136s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3f98c766-9f49-4fc4-b9a6-a952b5d873b3 tempest-GroupSnapshotsV319Test-601723024 None] group_snapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: created successfully Sep 26 17:32:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] group_snapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: deleting Sep 26 17:32:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] group_snapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: deleting {{(pid=83624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "cinder-quobyte-719e5522-16e6-41d5-bbe2-c88604b94d30" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-719e5522-16e6-41d5-bbe2-c88604b94d30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Deleting offline snapshot 719e5522-16e6-41d5-bbe2-c88604b94d30 of volume 2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] snapshot_file for this snap is: volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528c65a-f35e-4313-8b7d-da4895f07e2c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:42 devstack quobyte-client[83627]: System call of process 88887 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.499s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b22c80-48d3-44e7-99e6-afddce5f0daf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:43 devstack quobyte-client[83627]: System call of process 88890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34" returned: 0 in 0.393s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.295s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34.719e5522-16e6-41d5-bbe2-c88604b94d30" returned: 0 in 0.090s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-719e5522-16e6-41d5-bbe2-c88604b94d30" released by "_delete_snapshot" :: held 1.629s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" released by "delete_snapshot" :: held 1.661s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:44 devstack cinder-volume[83624]: WARNING cinder.quota [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1924093899 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1924093899, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:32:44 devstack cinder-volume[83624]: WARNING cinder.quota [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1924093899 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1924093899, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:32:44 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] Created reservations ['dfe85e06-6fb3-4592-8f9f-af3858d45508', '5de0fd14-4f2c-4476-b200-0040e55c6d0a', '47618281-0f23-44f7-bede-184c18412c7f', '7995784d-1721-473e-8611-367b603b3ddf'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:32:44 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b5bfbb45-0bc4-4b08-86f7-a6c7b5024907 tempest-GroupSnapshotsV319Test-601723024 None] group_snapshot 1b23ba8f-b24f-40bd-8dec-8255798ae974: deleted successfully Sep 26 17:32:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" acquired by "delete_volume" :: waited 0.033s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db4a7c-1ea5-4503-9793-b33b6f25472d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34" returned: 0 in 0.493s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e7d595d-3413-4c70-84bc-c4eec54d1e34" returned: 0 in 0.110s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Lock "cinder-quobyte-2e7d595d-3413-4c70-84bc-c4eec54d1e34" released by "delete_volume" :: held 0.767s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Created reservations ['94445a9e-ee50-4bcd-b19d-3db74efe04d5'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:32:46 devstack cinder-volume[83624]: WARNING cinder.quota [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1924093899 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1924093899, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Created reservations ['967df406-4184-41b7-a9b0-0d8c7ad354f4', '6adc1177-1eb0-45de-a9ed-01190affc167', '32e5bc6b-7049-472e-8d77-1decf47caefd', 'e5a020b3-37a2-415f-9dd1-7071187fd84a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:46 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:32:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c8df822f-182b-4ad0-a085-463212619a8a tempest-GroupSnapshotsV319Test-601723024 None] Delete group completed successfully. Sep 26 17:32:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-e3b9587d-ac2b-42bf-be47-2dc13a785e89 req-f031ce11-7249-4436-8bc7-5fab9bab6490 tempest-TaggedAttachmentsTest-1227835558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-e3b9587d-ac2b-42bf-be47-2dc13a785e89 req-f031ce11-7249-4436-8bc7-5fab9bab6490 tempest-TaggedAttachmentsTest-1227835558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-e3b9587d-ac2b-42bf-be47-2dc13a785e89 req-f031ce11-7249-4436-8bc7-5fab9bab6490 tempest-TaggedAttachmentsTest-1227835558 None] Terminate volume connection completed successfully. Sep 26 17:32:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-e3b9587d-ac2b-42bf-be47-2dc13a785e89 req-f031ce11-7249-4436-8bc7-5fab9bab6490 tempest-TaggedAttachmentsTest-1227835558 None] Deleting attachment 23ffae80-f3ee-43ae-b7f4-c9dee89a110e. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:INSERT=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=29,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:32:59 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Flow 'volume_create_manager' (3d8a4ff3-f21d-41f6-b762-a6bf532e3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ceb01b-ac6c-4fed-85ac-b430616f8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ceb01b-ac6c-4fed-85ac-b430616f8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1034568981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c9f31-71ef-4e99-97b2-a56838771f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab998d5740ae4110acb27a8ec24f0b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:32:59Z,use_quota=True,user_id='408beac1b81b4ee5b5e47add5c146869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfed5821-dd2f-4104-b4a5-5f0542e9a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfed5821-dd2f-4104-b4a5-5f0542e9a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f2270-d96c-4bf8-af4b-be5a3ecae5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f2270-d96c-4bf8-af4b-be5a3ecae5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4c9f31-71ef-4e99-97b2-a56838771f3f', 'volume_name': 'volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eb1c86-342a-43b0-889b-3ac33dd645d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eb1c86-342a-43b0-889b-3ac33dd645d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc763f49-a474-4765-b0a7-604c99c87313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:32:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f', 'volume_size': 1} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1034568981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c9f31-71ef-4e99-97b2-a56838771f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab998d5740ae4110acb27a8ec24f0b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:32:59Z,use_quota=True,user_id='408beac1b81b4ee5b5e47add5c146869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Creating volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:32:59 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:32:59 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=13, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f 1073741824" returned: 0 in 0.400s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:32:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.606s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc763f49-a474-4765-b0a7-604c99c87313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa267e-1e89-4948-b1e4-53d333fbc8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:00 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Volume volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f (1f4c9f31-71ef-4e99-97b2-a56838771f3f): created successfully Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa267e-1e89-4948-b1e4-53d333fbc8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Flow 'volume_create_manager' (3d8a4ff3-f21d-41f6-b762-a6bf532e3617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:33:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6e5139cd-3c75-4fb8-8568-f4c6e5f1938f tempest-SnapshotsActionsTest-1552837114 None] Created volume successfully. Sep 26 17:33:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Creating offline snapshot b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:33:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[32153e80-ddbb-4275-b927-bf065701b1ea]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f" returned: 0 in 0.448s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=14, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 1G" returned: 0 in 0.246s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack quobyte-client[83627]: System call of process 88991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.147s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:33:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.113s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.info" returned: 0 in 0.094s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.info" returned: 0 in 0.093s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.628s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c00bb5f9-86ed-499e-95c3-2f37f85b354c tempest-SnapshotsActionsTest-1552837114 None] Create snapshot completed successfully Sep 26 17:33:04 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Creating offline snapshot ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:33:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c91d4a-80e6-4792-a84e-0020b46f3c69]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.429s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:05 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=16, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 1G" returned: 0 in 0.277s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:05 devstack quobyte-client[83627]: System call of process 89004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.186s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.091s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.365s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-98116738-a82c-45c1-aa37-05238aecbaad tempest-SnapshotsActionsTest-1552837114 None] Create snapshot completed successfully Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Deleting offline snapshot ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] snapshot_file for this snap is: volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be608d-83f3-4609-a229-092781806a98]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:07 devstack quobyte-client[83627]: System call of process 89010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:07 devstack quobyte-client[83627]: System call of process 89010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:07 devstack quobyte-client[83627]: System call of process 89010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c60c2-4c39-4bec-a546-e5dc23b7b3ba]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.397s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.254s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96" released by "_delete_snapshot" :: held 1.442s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_snapshot" :: held 1.464s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:08 devstack cinder-volume[83624]: WARNING cinder.quota [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Created reservations ['2cac3b4d-937c-4cfc-9e0c-394f3ecb12f9', '7af2a10c-d1bf-4b82-86ef-2145ecde40e5', 'ff4547fd-8d3a-4fb7-9a4e-e1d80479a6f8', '163924fa-9f71-4ecc-bd19-2c5dede017a6'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Delete snapshot completed successfully. Sep 26 17:33:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf28b262-f524-47dc-90d9-044c161724fa tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-ef6f2eff-62f8-4d30-9b5e-bebbaa318b96-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.371s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:33:09 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Creating offline snapshot d2e8642b-7f51-4f48-a8bc-f83005cbbd74 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e858d8-c975-49f4-bb65-253dcfd4e498]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.442s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:10 devstack quobyte-client[83627]: System call of process 89024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:10 devstack quobyte-client[83627]: System call of process 89024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:10 devstack quobyte-client[83627]: System call of process 89024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:10 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=17, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 1G" returned: 0 in 0.342s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.154s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:33:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.096s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.427s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-5d136c9a-8233-471d-9209-c50bfa905ad5 tempest-SnapshotsActionsTest-1552837114 None] Create snapshot completed successfully Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-d2e8642b-7f51-4f48-a8bc-f83005cbbd74-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-d2e8642b-7f51-4f48-a8bc-f83005cbbd74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-d2e8642b-7f51-4f48-a8bc-f83005cbbd74" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-d2e8642b-7f51-4f48-a8bc-f83005cbbd74" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Deleting offline snapshot d2e8642b-7f51-4f48-a8bc-f83005cbbd74 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] snapshot_file for this snap is: volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eecc1db-0060-4424-b90f-ae70142ddd81]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:12 devstack quobyte-client[83627]: System call of process 89032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:12 devstack quobyte-client[83627]: System call of process 89032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.516s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:12 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b444ed09-c142-4b50-83d4-b7f726e7cf37]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.613s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:13 devstack quobyte-client[83627]: System call of process 89039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.263s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.d2e8642b-7f51-4f48-a8bc-f83005cbbd74" returned: 0 in 0.098s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-d2e8642b-7f51-4f48-a8bc-f83005cbbd74" released by "_delete_snapshot" :: held 1.891s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_snapshot" :: held 1.923s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:13 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Created reservations ['f62a6077-ef72-47f9-a1c3-c98e7dc6655d', '58755645-4efb-4cda-9ccb-53ce44b6c009', '3858f996-efd5-4615-9859-c5ef0cca1683', 'b7463e6c-7c7d-4793-8c62-7b819423904d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:14 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Delete snapshot completed successfully. Sep 26 17:33:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83fa11e2-d010-4241-86e7-b9faea3bfb45 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-d2e8642b-7f51-4f48-a8bc-f83005cbbd74-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Creating offline snapshot aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d40eda-c2b9-419d-8f05-5eafb8d2b2a2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:15 devstack quobyte-client[83627]: System call of process 89045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.482s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=18, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d 1G" returned: 0 in 0.334s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.174s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.142s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.086s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.524s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3f40fe18-88a9-4538-9b56-4be043153ee4 tempest-SnapshotsActionsTest-1552837114 None] Create snapshot completed successfully Sep 26 17:33:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Deleting offline snapshot aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] snapshot_file for this snap is: volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c411b-f5df-42ba-bbf6-72c49bd2fe01]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.409s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[42671c77-7942-4892-ae84-82edc1758025]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:19 devstack quobyte-client[83627]: System call of process 89061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:19 devstack quobyte-client[83627]: System call of process 89061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:19 devstack quobyte-client[83627]: System call of process 89061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:19 devstack quobyte-client[83627]: System call of process 89061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.776s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:20 devstack quobyte-client[83627]: System call of process 89084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:20 devstack quobyte-client[83627]: System call of process 89084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.562s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" returned: 0 in 0.145s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d" released by "_delete_snapshot" :: held 2.358s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_snapshot" :: held 2.392s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Created reservations ['cca02446-939c-4d82-87d0-d0e01a5bb07c', '8719235d-1472-4f42-9554-d377920051e1', 'af4cea11-aadd-484c-82fc-37ca5d17293f', '4ef585f9-2c54-4a7f-827a-ee50c71ecf1a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Delete snapshot completed successfully. Sep 26 17:33:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2fd5b192-b182-4cb8-97a0-a2fa107ac4b1 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-aec8c9a6-6bb7-4555-a9df-c6cf1e7d618d-delete_snapshot" released by "delete_snapshot" :: held 2.781s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Creating offline snapshot cdcc12c5-c046-4bb8-a11a-a33b68d447c2 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:33:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93369b9-a831-4843-8f27-0930479b8852]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:22 devstack quobyte-client[83627]: System call of process 89107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:22 devstack quobyte-client[83627]: System call of process 89107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:22 devstack quobyte-client[83627]: System call of process 89107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:22 devstack quobyte-client[83627]: System call of process 89107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.741s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:22 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=19, name=volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 1G" returned: 0 in 0.426s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img rebase -u -b volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.431s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:33:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Flow 'volume_create_manager' (9a2b2363-3108-4d6d-a661-5c994166b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca944003-b9da-4764-b320-61ec62f2d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca944003-b9da-4764-b320-61ec62f2d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-798853273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d790dc05-c854-4406-abd9-f1bde6ed1c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bd72076a194d59b89547c98e042373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:33:23Z,use_quota=True,user_id='918fbbced82d428db6bc84a7ae105d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca7a5e6-2b33-4bf3-8c55-a7c341fd530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca7a5e6-2b33-4bf3-8c55-a7c341fd530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35dda21-d20a-4c41-b7c7-c95fc7574127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35dda21-d20a-4c41-b7c7-c95fc7574127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd790dc05-c854-4406-abd9-f1bde6ed1c7b', 'volume_name': 'volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e46b7-e945-4325-94cb-31de2f56d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02e46b7-e945-4325-94cb-31de2f56d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587d5d80-a089-409b-a9f5-ceb583be7dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:24 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume d790dc05-c854-4406-abd9-f1bde6ed1c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b', 'volume_size': 1} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.734s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.130s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-798853273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d790dc05-c854-4406-abd9-f1bde6ed1c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bd72076a194d59b89547c98e042373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:33:23Z,use_quota=True,user_id='918fbbced82d428db6bc84a7ae105d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Creating volume d790dc05-c854-4406-abd9-f1bde6ed1c7b {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:33:24 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:33:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:24 devstack quobyte-client[83627]: System call of process 89121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:24 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=20, name=volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:33:24 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-25550d34-eb78-49a4-8969-d47f0714c271 tempest-SnapshotsActionsTest-1552837114 None] Create snapshot completed successfully Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b 1073741824" returned: 0 in 0.441s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] <== create_volume: return (616ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.641s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587d5d80-a089-409b-a9f5-ceb583be7dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2122d523-0f2a-4bfe-8b75-7f3eb2fef644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:33:25 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b (d790dc05-c854-4406-abd9-f1bde6ed1c7b): created successfully Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2122d523-0f2a-4bfe-8b75-7f3eb2fef644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:33:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Flow 'volume_create_manager' (9a2b2363-3108-4d6d-a661-5c994166b908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:33:25 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f0b51a5f-92e6-4615-9cc5-0bb0aedcf5ed tempest-AttachVolumeShelveTestJSON-1291269482 None] Created volume successfully. Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-cdcc12c5-c046-4bb8-a11a-a33b68d447c2-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-cdcc12c5-c046-4bb8-a11a-a33b68d447c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:26 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Acquiring lock "cinder-quobyte-cdcc12c5-c046-4bb8-a11a-a33b68d447c2" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-cdcc12c5-c046-4bb8-a11a-a33b68d447c2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Deleting offline snapshot cdcc12c5-c046-4bb8-a11a-a33b68d447c2 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] snapshot_file for this snap is: volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d423e74-4b2d-405f-ae58-7e4c0e3a9cc5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:26 devstack quobyte-client[83627]: System call of process 89125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.484s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[04efaee4-5f40-4012-9129-efa8893a1aae]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:27 devstack quobyte-client[83627]: System call of process 89131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.426s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.292s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.cdcc12c5-c046-4bb8-a11a-a33b68d447c2" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-cdcc12c5-c046-4bb8-a11a-a33b68d447c2" released by "_delete_snapshot" :: held 1.682s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_snapshot" :: held 1.706s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:28 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Created reservations ['34894e15-8fb0-4a7b-b709-ed3b3b0ac758', '366991e2-8488-4880-abcd-b7f4b5d7105f', 'be4a3986-33dc-494d-a7a3-6bd8fee2ce54', '31ef3119-ed19-4cdc-9bbd-c31aec9ba918'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Delete snapshot completed successfully. Sep 26 17:33:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b1595f6b-8f87-4d17-8bea-f79a024d3771 tempest-SnapshotsActionsTest-500341001 None] Lock "cinder-cdcc12c5-c046-4bb8-a11a-a33b68d447c2-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "cinder-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "cinder-quobyte-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Deleting offline snapshot b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 of volume 1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] snapshot_file for this snap is: volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f1d50-0d5c-4d07-8af0-798b3fa81991]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:31 devstack quobyte-client[83627]: System call of process 89160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.868s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:33:31 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82eecc5-0aa8-4d24-b06e-99c25a55ad65]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f" returned: 0 in 0.614s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:32 devstack quobyte-client[83627]: System call of process 89184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:32 devstack quobyte-client[83627]: System call of process 89184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.422s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "cinder-17eeb909-53ac-45e6-9ec5-3292022ca3eb-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f.b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" returned: 0 in 0.285s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "cinder-17eeb909-53ac-45e6-9ec5-3292022ca3eb-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0" released by "_delete_snapshot" :: held 2.731s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_snapshot" :: held 2.782s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:33 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "cinder-quobyte-17eeb909-53ac-45e6-9ec5-3292022ca3eb" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "cinder-quobyte-17eeb909-53ac-45e6-9ec5-3292022ca3eb" acquired by "delete_volume" :: waited 0.025s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db96b86-c1af-4718-9bf3-b20f3994136d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:33 devstack quobyte-client[83627]: System call of process 89189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:33 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Created reservations ['2b0429d1-8789-4b01-aeb9-1dcbf105822b', 'cb4552d4-56b6-4302-b246-54e8315517be', '3e95b7a2-52ae-4f92-948d-588c03dc4a6e', '281e133b-7778-46c9-b684-cb0821469e0c'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb" returned: 0 in 0.858s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-17eeb909-53ac-45e6-9ec5-3292022ca3eb" returned: 0 in 0.400s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "cinder-quobyte-17eeb909-53ac-45e6-9ec5-3292022ca3eb" released by "delete_volume" :: held 1.528s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Delete snapshot completed successfully. Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-62e66428-b688-4c15-b9ee-882717e52bb4 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-b1fdcdd6-1a17-4cd3-b443-5fafb99430c0-delete_snapshot" released by "delete_snapshot" :: held 4.655s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Created reservations ['1913eec8-5b84-4d1f-9c39-f3f665aa5e32', 'cafdacec-3672-4679-8ee4-531a0f80cea7', '2823e633-da66-455e-9303-1d057b07676a', 'd4ceb5e7-6f0b-48b7-83af-37666051d5d7'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:33:35 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Deleted volume successfully. Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-91129c87-07a6-4554-aa30-af26436d5462 tempest-TaggedAttachmentsTest-1227835558 None] Lock "cinder-17eeb909-53ac-45e6-9ec5-3292022ca3eb-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "cinder-1f4c9f31-71ef-4e99-97b2-a56838771f3f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-1f4c9f31-71ef-4e99-97b2-a56838771f3f-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:36 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e579f620-d817-40ff-937e-10155edc37b1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f" returned: 0 in 0.721s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1f4c9f31-71ef-4e99-97b2-a56838771f3f" returned: 0 in 0.380s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-quobyte-1f4c9f31-71ef-4e99-97b2-a56838771f3f" released by "delete_volume" :: held 1.524s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:37 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Created reservations ['7f6a2e43-95f1-4025-a929-6dec954885cf', '6f5d8b64-0190-419e-a3ac-907b90e81316', '1cc1b1c4-f05e-4f86-8345-301052c728fd', 'fd11c7ca-1a92-42cd-af95-50dc6674d888'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.249s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:38 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:33:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Deleted volume successfully. Sep 26 17:33:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc7f517f-4bdb-41a6-a730-331cdfaf4ea6 tempest-SnapshotsActionsTest-1552837114 None] Lock "cinder-1f4c9f31-71ef-4e99-97b2-a56838771f3f-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:33:48 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=45,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=4 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:33:49 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=39,cinder:UPDATE=51,cinder:DELETE=5,cinder:INSERT=13 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c2f40-8d10-4928-80e4-9347cc05b4fb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:33:57 devstack quobyte-client[83627]: System call of process 89271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b" returned: 0 in 0.470s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:33:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.523s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:33:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9061faef-9426-4cdc-8069-5df78c8b5a1d', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:33:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:33:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-b0c589c5-48b5-416e-9206-5cd14b5575f9 req-3191dda5-2531-4847-87b9-04e0daee57a9 tempest-AttachVolumeShelveTestJSON-1291269482 None] attachment_update completed successfully. Sep 26 17:34:08 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:34:08 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.165s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:34:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Flow 'volume_create_manager' (490e3dac-173f-4b56-bad4-bf2a27d8d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd276d0-fe52-406b-a9c9-e671bc5c8125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd276d0-fe52-406b-a9c9-e671bc5c8125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1753601162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a74e67c-e412-479e-94ea-7790f39b862d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2e2c86da10412ab6b8cc554e6413fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:34:21Z,use_quota=True,user_id='28c98512a88f4fe1851696ec12853c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55153df4-b268-484a-911b-14909a55f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55153df4-b268-484a-911b-14909a55f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5496fd14-8312-4124-bcff-b6d10d9294e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:21 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5496fd14-8312-4124-bcff-b6d10d9294e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a74e67c-e412-479e-94ea-7790f39b862d', 'volume_name': 'volume-4a74e67c-e412-479e-94ea-7790f39b862d', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d7ae6-c42b-4cd2-a949-3e9a158ede41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d7ae6-c42b-4cd2-a949-3e9a158ede41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02b48ab-5518-41f5-b10b-b6d3ae8afb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:22 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Volume 4a74e67c-e412-479e-94ea-7790f39b862d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a74e67c-e412-479e-94ea-7790f39b862d', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Cloning 4a74e67c-e412-479e-94ea-7790f39b862d from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 17:34:22 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Image download 20.69 MB at 20.69 MB/s Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b273820b-ea4c-438a-99b1-6a7dcc88f4ca]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:23 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD Sep 26 17:34:23 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:34:25 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Sep 26 17:34:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD" returned: 0 in 2.213s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:25 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 is fetched for user 28c98512a88f4fe1851696ec12853c13. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 17:34:25 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb84fd5-c3a7-4c56-867e-b34d34fe4a86]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:25 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD Sep 26 17:34:25 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:34:27 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Sep 26 17:34:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD" returned: 0 in 2.577s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1753601162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a74e67c-e412-479e-94ea-7790f39b862d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2e2c86da10412ab6b8cc554e6413fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:34:21Z,use_quota=True,user_id='28c98512a88f4fe1851696ec12853c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Creating volume 4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:34:28 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:28 devstack quobyte-client[83627]: System call of process 89743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:28 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=21, name=volume-4a74e67c-e412-479e-94ea-7790f39b862d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d 1073741824" returned: 0 in 0.403s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] <== create_volume: return (635ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:34:28 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Attempting download of b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume 4a74e67c-e412-479e-94ea-7790f39b862d. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 17:34:29 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbb806-f0c7-4646-8cf2-19de25c8d95c]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_cbwaz0u7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_cbwaz0u7" returned: 0 in 0.459s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_cbwaz0u7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_cbwaz0u7" returned: 1 in 0.507s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_cbwaz0u7' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f0909-3283-4320-9a90-5d90148b592f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] b453c7ff-249a-4559-a968-e9bd0fbe8a12 was qcow2, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 17:34:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:31 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=21, name=volume-4a74e67c-e412-479e-94ea-7790f39b862d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:34:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 0 in 2.542s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:33 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_8v8rny1zdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:34:33 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Converted 112.00 MB image at 41.78 MB/s Sep 26 17:34:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:34 devstack quobyte-client[83627]: System call of process 89866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:34 devstack quobyte-client[83627]: System call of process 89866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:34 devstack quobyte-client[83627]: System call of process 89866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d 1G" returned: 0 in 0.579s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[80921b78-933d-4edb-b863-33da206c0659]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:35 devstack quobyte-client[83627]: System call of process 89875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:35 devstack quobyte-client[83627]: System call of process 89875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:35 devstack quobyte-client[83627]: System call of process 89875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 0 in 1.426s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:36 devstack quobyte-client[83627]: System call of process 89882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 1 in 0.826s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Downloaded image b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume 4a74e67c-e412-479e-94ea-7790f39b862d successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 for user 28c98512a88f4fe1851696ec12853c13 is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Marking volume 4a74e67c-e412-479e-94ea-7790f39b862d as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Copying metadata from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 to 4a74e67c-e412-479e-94ea-7790f39b862d. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 17:34:37 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Creating volume glance metadata for volume 4a74e67c-e412-479e-94ea-7790f39b862d backed by image b453c7ff-249a-4559-a968-e9bd0fbe8a12 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 17:34:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02b48ab-5518-41f5-b10b-b6d3ae8afb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a74e67c-e412-479e-94ea-7790f39b862d', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568ae20-75a0-4dd7-b124-ac0a43f82bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:34:38 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Volume volume-4a74e67c-e412-479e-94ea-7790f39b862d (4a74e67c-e412-479e-94ea-7790f39b862d): created successfully Sep 26 17:34:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568ae20-75a0-4dd7-b124-ac0a43f82bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:34:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Flow 'volume_create_manager' (490e3dac-173f-4b56-bad4-bf2a27d8d715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:34:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b1665625-f523-4154-b40b-2734afc5d36a tempest-VolumesImageMetadata-2021961233 None] Created volume successfully. Sep 26 17:34:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Acquiring lock "cinder-4a74e67c-e412-479e-94ea-7790f39b862d-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:34:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "cinder-4a74e67c-e412-479e-94ea-7790f39b862d-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:34:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:34:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Acquiring lock "cinder-quobyte-4a74e67c-e412-479e-94ea-7790f39b862d" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:34:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "cinder-quobyte-4a74e67c-e412-479e-94ea-7790f39b862d" acquired by "delete_volume" :: waited 0.066s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:34:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e35722-d6f7-42e7-b4b9-d14adf02f222]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:34:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:42 devstack quobyte-client[83627]: System call of process 89922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 0 in 1.577s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:44 devstack quobyte-client[83627]: System call of process 89954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:44 devstack quobyte-client[83627]: System call of process 89954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:34:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 1 in 1.519s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:34:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4a74e67c-e412-479e-94ea-7790f39b862d" returned: 0 in 0.693s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "cinder-quobyte-4a74e67c-e412-479e-94ea-7790f39b862d" released by "delete_volume" :: held 4.904s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Created reservations ['8f0b3412-31b6-460f-98bc-919c9e45c186', 'b191cb87-dad5-4d25-8e6a-62b1d716445c', '12987199-4d8c-4921-88db-cf8f4004756e', '3ac8dcc6-6a0e-4820-a7ef-d793f7404076'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.034s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:34:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:34:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.217s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:34:47 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:34:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Deleted volume successfully. Sep 26 17:34:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6505be84-4e7f-4e79-8eb9-4cab712c46e3 tempest-VolumesImageMetadata-2021961233 None] Lock "cinder-4a74e67c-e412-479e-94ea-7790f39b862d-delete_volume" released by "delete_volume" :: held 7.455s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:34:56 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:34:57 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=20,cinder:UPDATE=14,cinder:INSERT=17,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:35:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:05 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:35:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Flow 'volume_create_manager' (4bff48e4-4101-4703-9270-e397bb4312ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faea4e7-bcf3-482c-a091-8d5b2b39591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faea4e7-bcf3-482c-a091-8d5b2b39591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2085020404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31670ab1-405b-4650-98fa-8a9f270dcea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d47c5ee83724dd18e2a198afcc7a24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:05Z,use_quota=True,user_id='1d074b66530849999bf0cb6645e170d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9789677a-64ab-40f0-b7f9-27b402393e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9789677a-64ab-40f0-b7f9-27b402393e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982aea5d-1df8-4aa6-b2c4-6199b66916da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982aea5d-1df8-4aa6-b2c4-6199b66916da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31670ab1-405b-4650-98fa-8a9f270dcea5', 'volume_name': 'volume-31670ab1-405b-4650-98fa-8a9f270dcea5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6ba713-3205-4f80-958a-4af0f01f45ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6ba713-3205-4f80-958a-4af0f01f45ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0ffa8d-844c-4be4-a37d-324d3c96dbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:06 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Volume 31670ab1-405b-4650-98fa-8a9f270dcea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31670ab1-405b-4650-98fa-8a9f270dcea5', 'volume_size': 1} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2085020404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31670ab1-405b-4650-98fa-8a9f270dcea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d47c5ee83724dd18e2a198afcc7a24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:05Z,use_quota=True,user_id='1d074b66530849999bf0cb6645e170d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Creating volume 31670ab1-405b-4650-98fa-8a9f270dcea5 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:35:06 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:35:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:07 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=22, name=volume-31670ab1-405b-4650-98fa-8a9f270dcea5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5 1073741824" returned: 0 in 1.435s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5" returned: 0 in 0.250s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] <== create_volume: return (1999ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0ffa8d-844c-4be4-a37d-324d3c96dbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31670ab1-405b-4650-98fa-8a9f270dcea5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1847e-3b35-4098-bb30-e42b73549039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:08 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Volume volume-31670ab1-405b-4650-98fa-8a9f270dcea5 (31670ab1-405b-4650-98fa-8a9f270dcea5): created successfully Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1847e-3b35-4098-bb30-e42b73549039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Flow 'volume_create_manager' (4bff48e4-4101-4703-9270-e397bb4312ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-5f998a94-32ea-418c-a0cc-5819e578b06c tempest-AbsoluteLimitsTests-2113513259 None] Created volume successfully. Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.172s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Acquiring lock "cinder-31670ab1-405b-4650-98fa-8a9f270dcea5-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "cinder-31670ab1-405b-4650-98fa-8a9f270dcea5-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Acquiring lock "cinder-quobyte-31670ab1-405b-4650-98fa-8a9f270dcea5" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "cinder-quobyte-31670ab1-405b-4650-98fa-8a9f270dcea5" acquired by "delete_volume" :: waited 0.066s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9be6be-bf88-4aa4-b077-3d45024ac52e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5" returned: 0 in 0.831s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-31670ab1-405b-4650-98fa-8a9f270dcea5" returned: 0 in 0.204s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "cinder-quobyte-31670ab1-405b-4650-98fa-8a9f270dcea5" released by "delete_volume" :: held 1.383s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Created reservations ['5578e982-bd3b-425b-8a02-283f8d842008', '799e321c-b314-4c50-9c29-f6ef190fc27f', '0b43043e-58a6-4306-ad9c-5d4e7ca7afea', '9c1cd2fc-cd2e-4aaf-bb9f-4ca42000c919'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.172s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:12 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:35:13 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Deleted volume successfully. Sep 26 17:35:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ec4c11d3-68ff-42c1-8de1-69bd90181471 tempest-AbsoluteLimitsTests-2113513259 None] Lock "cinder-31670ab1-405b-4650-98fa-8a9f270dcea5-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:22 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=1,cinder:UPDATE=15 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:35:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (cf0de34c-7725-4b52-b0bc-3457f0f3766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ca11ea-59d5-4a5b-a1ea-409658a6b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ca11ea-59d5-4a5b-a1ea-409658a6b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-915915418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b4178f-30fe-4b33-95c1-2709d10627c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25aeef342c348e7b5122bad6da0ae26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:23Z,use_quota=True,user_id='e5495abac9e94d548e31084b10d54c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e505a694-1b50-4a07-b547-3708d2f00537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e505a694-1b50-4a07-b547-3708d2f00537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da11562-1538-4d2f-8d68-531b205663fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da11562-1538-4d2f-8d68-531b205663fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b4178f-30fe-4b33-95c1-2709d10627c6', 'volume_name': 'volume-70b4178f-30fe-4b33-95c1-2709d10627c6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4c7fa2-c522-415a-8cf1-523e1837c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4c7fa2-c522-415a-8cf1-523e1837c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95abd127-ad6e-4bf6-beb2-3be92ca04bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:23 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Volume 70b4178f-30fe-4b33-95c1-2709d10627c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b4178f-30fe-4b33-95c1-2709d10627c6', 'volume_size': 1} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-915915418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b4178f-30fe-4b33-95c1-2709d10627c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25aeef342c348e7b5122bad6da0ae26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:23Z,use_quota=True,user_id='e5495abac9e94d548e31084b10d54c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Creating volume 70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:35:23 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:35:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:24 devstack quobyte-client[83627]: System call of process 90157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:24 devstack quobyte-client[83627]: System call of process 90157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:24 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=23, name=volume-70b4178f-30fe-4b33-95c1-2709d10627c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 1073741824" returned: 0 in 0.492s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.123s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95abd127-ad6e-4bf6-beb2-3be92ca04bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b4178f-30fe-4b33-95c1-2709d10627c6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc671498-3603-4dbd-a336-e99b58bb78f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:25 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Volume volume-70b4178f-30fe-4b33-95c1-2709d10627c6 (70b4178f-30fe-4b33-95c1-2709d10627c6): created successfully Sep 26 17:35:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc671498-3603-4dbd-a336-e99b58bb78f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (cf0de34c-7725-4b52-b0bc-3457f0f3766e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:25 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d125eadf-ffca-48dc-8f95-384b93c93255 tempest-VolumesDeleteCascade-62816176 None] Created volume successfully. Sep 26 17:35:26 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Creating offline snapshot 088ce7d7-dca1-41c4-9c4b-25adc860d913 of volume 70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4cf63-3061-463b-a7e8-fd1e45800f82]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:26 devstack quobyte-client[83627]: System call of process 90161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:26 devstack quobyte-client[83627]: System call of process 90161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.752s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:27 devstack quobyte-client[83627]: System call of process 90166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:27 devstack quobyte-client[83627]: System call of process 90166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:27 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=24, name=volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 1G" returned: 0 in 0.365s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:27 devstack quobyte-client[83627]: System call of process 90169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.213s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.129s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:35:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.229s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.info" returned: 0 in 0.139s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.info" returned: 0 in 0.125s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a04f4f0a-ef48-4209-b926-d5d464485efc tempest-VolumesDeleteCascade-62816176 None] Create snapshot completed successfully Sep 26 17:35:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Creating offline snapshot f2845cd2-d59a-4a60-af6d-aaf7281ca0ae of volume 70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:35:29 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422ab4a-1c58-4c98-865a-a396f75349e3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.757s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b4178f-30fe-4b33-95c1-2709d10627c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:35:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:30 devstack quobyte-client[83627]: System call of process 90179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:30 devstack quobyte-client[83627]: System call of process 90179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:31 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=26, name=volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae 1G" returned: 0 in 0.497s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:31 devstack quobyte-client[83627]: System call of process 90192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:31 devstack quobyte-client[83627]: System call of process 90192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:31 devstack quobyte-client[83627]: System call of process 90192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 0.575s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 0.191s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 0.216s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-63249d82-4ac6-4712-a9e6-db2ef45f0ac2 tempest-VolumesDeleteCascade-62816176 None] Create snapshot completed successfully Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-70b4178f-30fe-4b33-95c1-2709d10627c6-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-70b4178f-30fe-4b33-95c1-2709d10627c6-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Performing cascade delete. {{(pid=83624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-088ce7d7-dca1-41c4-9c4b-25adc860d913-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-088ce7d7-dca1-41c4-9c4b-25adc860d913-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-088ce7d7-dca1-41c4-9c4b-25adc860d913" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-088ce7d7-dca1-41c4-9c4b-25adc860d913" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Deleting offline snapshot 088ce7d7-dca1-41c4-9c4b-25adc860d913 of volume 70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] snapshot_file for this snap is: volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78212cf-42e4-4ed5-9260-e4a0e32286b9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:35 devstack quobyte-client[83627]: System call of process 90222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:35 devstack quobyte-client[83627]: System call of process 90222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.686s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b4178f-30fe-4b33-95c1-2709d10627c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:35:35 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[389aac3c-fcb5-4ace-b625-4a1e67844d1b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:36 devstack quobyte-client[83627]: System call of process 90231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.599s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33c9315-5d26-4136-8f43-c9ee83aea97e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:37 devstack quobyte-client[83627]: System call of process 90238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 1.064s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:37 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b4178f-30fe-4b33-95c1-2709d10627c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:35:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b85475-2471-4f8f-9c88-9db0f1e428b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:38 devstack quobyte-client[83627]: System call of process 90247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.889s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b4178f-30fe-4b33-95c1-2709d10627c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:35:38 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e25e42c-0837-4e34-a003-32b29c6c78ee]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:39 devstack quobyte-client[83627]: System call of process 90251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:39 devstack quobyte-client[83627]: System call of process 90251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:39 devstack quobyte-client[83627]: System call of process 90251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.717s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:39 devstack quobyte-client[83627]: System call of process 90255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.321s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.088ce7d7-dca1-41c4-9c4b-25adc860d913" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae -F qcow2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:40 devstack quobyte-client[83627]: System call of process 90260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:40 devstack quobyte-client[83627]: System call of process 90260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:40 devstack quobyte-client[83627]: System call of process 90260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img rebase -u -b volume-70b4178f-30fe-4b33-95c1-2709d10627c6 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae -F qcow2" returned: 0 in 0.354s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-088ce7d7-dca1-41c4-9c4b-25adc860d913" released by "_delete_snapshot" :: held 6.329s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" released by "delete_snapshot" :: held 6.442s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:41 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Flow 'volume_create_manager' (fc25f355-90ae-46ea-902f-368430436304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debd3f6e-0901-4d1a-b2bf-67e853fb041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debd3f6e-0901-4d1a-b2bf-67e853fb041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1089427377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01a94c1d05b4ac6869aac4f6ed1852b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:41Z,use_quota=True,user_id='de5f5502433b412bb90b041bbe1f9ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9ecd6c-0f8b-4ca6-ae88-0f367878092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9ecd6c-0f8b-4ca6-ae88-0f367878092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ecab38-84b1-403d-932a-0db051d13153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ecab38-84b1-403d-932a-0db051d13153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15', 'volume_name': 'volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9bdaa6-151e-4ada-aacf-75c194c21d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9bdaa6-151e-4ada-aacf-75c194c21d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb34af-c2e3-43b5-baf3-65f8ab909ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Volume c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15', 'volume_size': 1} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1089427377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01a94c1d05b4ac6869aac4f6ed1852b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:41Z,use_quota=True,user_id='de5f5502433b412bb90b041bbe1f9ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Creating volume c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:35:41 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:35:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:41 devstack quobyte-client[83627]: System call of process 90272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:41 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=27, name=volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 1073741824" returned: 0 in 0.548s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" returned: 0 in 0.400s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] <== create_volume: return (1034ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:35:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb34af-c2e3-43b5-baf3-65f8ab909ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fa60a9-386e-43db-9047-c956eb370c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Volume volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 (c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15): created successfully Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fa60a9-386e-43db-9047-c956eb370c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Flow 'volume_create_manager' (fc25f355-90ae-46ea-902f-368430436304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Created reservations ['6264181f-2ba4-420c-8480-c6752e523b3f', 'c3df4883-0910-49e3-9b16-08d8401507bc', 'e9215f3c-f4ed-4819-8dcc-64ad84bbca96', '38cb002b-7105-43a4-b61e-3aea870e3cb3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:35:43 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-94611ab2-7e17-45cd-87ca-9a53ec550c4e tempest-ServersNegativeTestJSON-365966237 None] Created volume successfully. Sep 26 17:35:43 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Delete snapshot completed successfully. Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-088ce7d7-dca1-41c4-9c4b-25adc860d913-delete_snapshot" released by "delete_snapshot" :: held 8.898s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Deleting offline snapshot f2845cd2-d59a-4a60-af6d-aaf7281ca0ae of volume 70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] snapshot_file for this snap is: volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d9acc-7bac-486d-81e5-c9a57a61d41c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:44 devstack quobyte-client[83627]: System call of process 90290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:44 devstack quobyte-client[83627]: System call of process 90290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 1.066s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b4178f-30fe-4b33-95c1-2709d10627c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:35:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[09023ff2-bd67-4bfe-b7a0-4cb226fd5257]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:46 devstack quobyte-client[83627]: System call of process 90301 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 1.191s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6.f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" returned: 0 in 0.636s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Flow 'volume_create_manager' (8d17aa12-113c-41d5-99b4-02332807e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0eebcd-5eaf-416d-846a-e33d080b283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae" released by "_delete_snapshot" :: held 4.512s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0eebcd-5eaf-416d-846a-e33d080b283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-208727836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9726ab38-0450-4e31-ac8d-a55f66fa3ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01a94c1d05b4ac6869aac4f6ed1852b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:47Z,use_quota=True,user_id='de5f5502433b412bb90b041bbe1f9ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55888b35-f4f8-4c27-9d76-b5ca6fd0e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55888b35-f4f8-4c27-9d76-b5ca6fd0e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edacf2ce-fe8e-4ea4-abcb-b42f9266b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edacf2ce-fe8e-4ea4-abcb-b42f9266b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9726ab38-0450-4e31-ac8d-a55f66fa3ab3', 'volume_name': 'volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fff3ea-85d1-45f6-9595-1d29ba9495fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fff3ea-85d1-45f6-9595-1d29ba9495fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73243cd-a074-4a11-84f4-bdf0526e1ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Volume 9726ab38-0450-4e31-ac8d-a55f66fa3ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3', 'volume_size': 1} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-208727836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9726ab38-0450-4e31-ac8d-a55f66fa3ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01a94c1d05b4ac6869aac4f6ed1852b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:47Z,use_quota=True,user_id='de5f5502433b412bb90b041bbe1f9ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Creating volume 9726ab38-0450-4e31-ac8d-a55f66fa3ab3 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:35:48 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" released by "delete_snapshot" :: held 4.800s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:48 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=28, name=volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 1073741824" returned: 0 in 0.871s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" returned: 0 in 0.282s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] <== create_volume: return (1249ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Created reservations ['178cddec-5719-41ad-b06a-76ba3de111e1', '00695f55-96db-4e13-8466-1c0aceb85ef0', '9f449d6e-3109-4087-a8a4-3f57852e097f', '0404c0c6-682c-4308-a790-ebd3971164d2'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73243cd-a074-4a11-84f4-bdf0526e1ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1e64ea-a918-429c-9c0c-e381f75dbec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Delete snapshot completed successfully. Sep 26 17:35:49 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Volume volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 (9726ab38-0450-4e31-ac8d-a55f66fa3ab3): created successfully Sep 26 17:35:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1e64ea-a918-429c-9c0c-e381f75dbec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Flow 'volume_create_manager' (8d17aa12-113c-41d5-99b4-02332807e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-f2845cd2-d59a-4a60-af6d-aaf7281ca0ae-delete_snapshot" released by "delete_snapshot" :: held 6.455s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Snapshots deleted, issuing volume delete {{(pid=83624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-12bc2285-857f-4b8b-8d90-7ea58a80f853 tempest-ServersNegativeTestJSON-365966237 None] Created volume successfully. Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" acquired by "delete_volume" :: waited 0.033s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202a851-b41a-4ffc-9aaf-7a2502ebb2ea]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:50 devstack quobyte-client[83627]: System call of process 90327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:50 devstack quobyte-client[83627]: System call of process 90327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.586s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-70b4178f-30fe-4b33-95c1-2709d10627c6" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-70b4178f-30fe-4b33-95c1-2709d10627c6" released by "delete_volume" :: held 1.095s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Created reservations ['3498ae0b-edb0-4b15-8a58-dfe4e6446f01', '68fe7e90-4177-405d-aa60-5c2ef44620aa', '85b9aa75-77b3-4df3-981e-c75969309a46', '1b671198-8cbc-4a4b-a669-cb987c75b227'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "cinder-9726ab38-0450-4e31-ac8d-a55f66fa3ab3-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-9726ab38-0450-4e31-ac8d-a55f66fa3ab3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "cinder-quobyte-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-quobyte-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" acquired by "delete_volume" :: waited 0.023s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[133dc53f-e138-4837-82b5-dc033d55551c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.417s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:53 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:35:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Deleted volume successfully. Sep 26 17:35:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" returned: 0 in 1.695s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:53 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (e41224f7-08d1-478d-ac57-77a011bd96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933edaf1-6947-40ab-b1fa-63401fbc9b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933edaf1-6947-40ab-b1fa-63401fbc9b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1508023746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dd4eb4-f682-4709-a01b-2bf475e10791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25aeef342c348e7b5122bad6da0ae26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:53Z,use_quota=True,user_id='e5495abac9e94d548e31084b10d54c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b039ad4-04f8-4ff7-8d93-60eb4361cb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b039ad4-04f8-4ff7-8d93-60eb4361cb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db36400-c51e-4195-bd2f-fc570da08735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db36400-c51e-4195-bd2f-fc570da08735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dd4eb4-f682-4709-a01b-2bf475e10791', 'volume_name': 'volume-e4dd4eb4-f682-4709-a01b-2bf475e10791', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135b3d8e-1b44-4ba7-8a2f-64bdd7d220c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135b3d8e-1b44-4ba7-8a2f-64bdd7d220c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c035369-c064-4aec-a9d7-4fdedfde0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:54 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Volume e4dd4eb4-f682-4709-a01b-2bf475e10791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dd4eb4-f682-4709-a01b-2bf475e10791', 'volume_size': 1} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1508023746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dd4eb4-f682-4709-a01b-2bf475e10791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25aeef342c348e7b5122bad6da0ae26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:35:53Z,use_quota=True,user_id='e5495abac9e94d548e31084b10d54c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Creating volume e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:35:54 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:54 devstack quobyte-client[83627]: System call of process 90338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-81002b46-b556-49b0-be5b-c5cbbbc33c04 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-70b4178f-30fe-4b33-95c1-2709d10627c6-delete_volume" released by "delete_volume" :: held 20.332s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:54 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=29, name=volume-e4dd4eb4-f682-4709-a01b-2bf475e10791, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" returned: 0 in 1.195s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-quobyte-9726ab38-0450-4e31-ac8d-a55f66fa3ab3" released by "delete_volume" :: held 3.023s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 1073741824" returned: 0 in 0.534s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.539s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c035369-c064-4aec-a9d7-4fdedfde0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dd4eb4-f682-4709-a01b-2bf475e10791', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d40de02-ea54-4c17-bd58-c938146797ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:35:55 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Volume volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 (e4dd4eb4-f682-4709-a01b-2bf475e10791): created successfully Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d40de02-ea54-4c17-bd58-c938146797ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (e41224f7-08d1-478d-ac57-77a011bd96e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:35:55 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Created reservations ['f9126749-23b0-4a64-a975-1a671baabb9f', '2bdf5b02-641b-4cda-afc7-dbaa27852860', '4dadf172-b28b-4e31-a113-6d0959cb110c', '0397c829-3202-4158-9606-4c49357f7703'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:35:55 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-aec011b1-e216-4366-b2a9-5894c14951e2 tempest-VolumesDeleteCascade-62816176 None] Created volume successfully. Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.655s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:56 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:35:57 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Deleted volume successfully. Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "cinder-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dcc18a6a-b1d6-448f-83e0-c0172939b6e3 tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-9726ab38-0450-4e31-ac8d-a55f66fa3ab3-delete_volume" released by "delete_volume" :: held 5.927s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:35:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "cinder-quobyte-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Creating offline snapshot 8bb2e8eb-55ac-4b55-97e0-cede95d484cb of volume e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-quobyte-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" acquired by "delete_volume" :: waited 0.042s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[64281e20-2a10-4dc6-9f7d-37f3379ac5f4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924912d-fd13-4cd6-9f5d-033fba9725bc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:35:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90356 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 1.352s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack quobyte-client[83627]: System call of process 90391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:35:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" returned: 0 in 1.546s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:35:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:35:59 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=30, name=volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:36:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" returned: 0 in 0.557s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb 1G" returned: 0 in 1.227s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:00 devstack quobyte-client[83627]: System call of process 90403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-quobyte-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15" released by "delete_volume" :: held 2.855s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img rebase -u -b volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.515s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.275s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.362s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:01 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Created reservations ['d7dbe02f-7e99-4351-a6c3-670677779cbd', '66cba262-cfa7-4940-ae2c-df098868c7af', 'dd3ab2ea-d020-4a44-bea3-3dc45b26dc2d', 'ebaa2cb6-245a-43c3-87d2-34d7df60a0dd'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.info" returned: 0 in 0.375s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.info" returned: 0 in 0.264s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.749s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4165bdae-e99b-45b4-b941-67eafd8746ec tempest-VolumesDeleteCascade-62816176 None] Create snapshot completed successfully Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:02 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Deleted volume successfully. Sep 26 17:36:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-3da54d06-e949-4709-be8c-337286af8c7c tempest-ServersNegativeTestJSON-365966237 None] Lock "cinder-c8c0bf2b-b32e-4997-af3a-3d5dd79f5e15-delete_volume" released by "delete_volume" :: held 5.445s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:03 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (dc0a849a-0a7f-45b5-a953-249f9191d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf08f52b-66ef-46fa-a833-48d261747b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf08f52b-66ef-46fa-a833-48d261747b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-633778728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a17577-19a1-4e4c-b254-f52c4c063554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25aeef342c348e7b5122bad6da0ae26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8bb2e8eb-55ac-4b55-97e0-cede95d484cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:04Z,use_quota=True,user_id='e5495abac9e94d548e31084b10d54c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9a92cb-f6fe-4d93-8271-f757cfccc4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9a92cb-f6fe-4d93-8271-f757cfccc4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca6fb76-b6e5-45d1-9174-ef61855c56bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca6fb76-b6e5-45d1-9174-ef61855c56bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5a17577-19a1-4e4c-b254-f52c4c063554', 'volume_name': 'volume-b5a17577-19a1-4e4c-b254-f52c4c063554', 'volume_size': 1, 'snapshot_id': '8bb2e8eb-55ac-4b55-97e0-cede95d484cb'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978df480-0b7c-4510-8f4e-3aa8ba812443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978df480-0b7c-4510-8f4e-3aa8ba812443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e9fb81-3926-4d73-8c5f-ba8aba31f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:04 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Volume b5a17577-19a1-4e4c-b254-f52c4c063554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5a17577-19a1-4e4c-b254-f52c4c063554', 'volume_size': 1, 'snapshot_id': '8bb2e8eb-55ac-4b55-97e0-cede95d484cb'} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-b5a17577-19a1-4e4c-b254-f52c4c063554" by "_create_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-b5a17577-19a1-4e4c-b254-f52c4c063554" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Creating volume b5a17577-19a1-4e4c-b254-f52c4c063554 from snapshot 8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" by "_copy_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] snapshot: 8bb2e8eb-55ac-4b55-97e0-cede95d484cb, volume: b5a17577-19a1-4e4c-b254-f52c4c063554, {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b7845a-e538-4ac4-9bba-613a1c38d7f6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:05 devstack quobyte-client[83627]: System call of process 90411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:05 devstack quobyte-client[83627]: System call of process 90411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:05 devstack quobyte-client[83627]: System call of process 90411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 1.011s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4dd4eb4-f682-4709-a01b-2bf475e10791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Creating direct copy from snapshot {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b8f8d3-f8a2-4d54-9302-9e939652348f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:06 devstack quobyte-client[83627]: System call of process 90436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.814s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:06 devstack cinder-volume[83624]: DEBUG cinder.utils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 not found in is_blk_device check {{(pid=83624) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 26 17:36:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:06 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=32, name=volume-b5a17577-19a1-4e4c-b254-f52c4c063554, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.683s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554" returned: 0 in 5.501s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7957237-f8b9-4dcc-b40c-8c84a21b77f6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.528s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:36:12 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Converted 1024.00 MB image at 185.71 MB/s Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" released by "_copy_volume_from_snapshot" :: held 8.414s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-b5a17577-19a1-4e4c-b254-f52c4c063554" released by "_create_volume_from_snapshot" :: held 8.464s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.486s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e9fb81-3926-4d73-8c5f-ba8aba31f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a17577-19a1-4e4c-b254-f52c4c063554', 'volume_size': 1, 'snapshot_id': '8bb2e8eb-55ac-4b55-97e0-cede95d484cb'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063a90cd-c1f1-446d-8c18-17b66e05db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:12 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Volume volume-b5a17577-19a1-4e4c-b254-f52c4c063554 (b5a17577-19a1-4e4c-b254-f52c4c063554): created successfully Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063a90cd-c1f1-446d-8c18-17b66e05db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Flow 'volume_create_manager' (dc0a849a-0a7f-45b5-a953-249f9191d625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:12 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0a688f2b-b6b4-4456-a8e2-768884062686 tempest-VolumesDeleteCascade-62816176 None] Created volume successfully. Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-e4dd4eb4-f682-4709-a01b-2bf475e10791-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-e4dd4eb4-f682-4709-a01b-2bf475e10791-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Performing cascade delete. {{(pid=83624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Deleting offline snapshot 8bb2e8eb-55ac-4b55-97e0-cede95d484cb of volume e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] snapshot_file for this snap is: volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baafe30-5836-4af4-954f-49d950e231a7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:14 devstack quobyte-client[83627]: System call of process 90484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.488s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4dd4eb4-f682-4709-a01b-2bf475e10791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b589b2-c78d-418c-9323-4241a4c01df4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.500s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.240s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791.8bb2e8eb-55ac-4b55-97e0-cede95d484cb" returned: 0 in 0.096s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-8bb2e8eb-55ac-4b55-97e0-cede95d484cb" released by "_delete_snapshot" :: held 1.673s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" released by "delete_snapshot" :: held 1.700s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:15 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Created reservations ['8b91ab67-741e-4faa-9d9b-30b0d1b1ea35', '04decbf7-09a4-4a02-8d04-e31d6ec7efa1', '089d6726-6782-4c6a-a786-c8055217de50', '25433e10-5590-498d-b2b4-4e1836f8fd07'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Delete snapshot completed successfully. Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-8bb2e8eb-55ac-4b55-97e0-cede95d484cb-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Snapshots deleted, issuing volume delete {{(pid=83624) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" acquired by "delete_volume" :: waited 0.026s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b70b7-b410-46fe-9b56-02040fada5e0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.452s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e4dd4eb4-f682-4709-a01b-2bf475e10791" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-e4dd4eb4-f682-4709-a01b-2bf475e10791" released by "delete_volume" :: held 0.799s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Created reservations ['e2a4ac8b-0c9f-4831-851f-e59e5140be84', '0b01322e-e135-4fa6-8c5e-08619004127a', 'c4ce1098-0681-4e97-989b-ea66f1627338', 'fa9f4d42-5740-4c4c-89d8-e6855ad921c5'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b94f655c-9804-4666-8f5c-32c29d2102fe req-16a620b3-262f-42ae-911b-eba7c4b6ca98 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b94f655c-9804-4666-8f5c-32c29d2102fe req-16a620b3-262f-42ae-911b-eba7c4b6ca98 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-b94f655c-9804-4666-8f5c-32c29d2102fe req-16a620b3-262f-42ae-911b-eba7c4b6ca98 tempest-AttachVolumeShelveTestJSON-1291269482 None] Terminate volume connection completed successfully. Sep 26 17:36:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b94f655c-9804-4666-8f5c-32c29d2102fe req-16a620b3-262f-42ae-911b-eba7c4b6ca98 tempest-AttachVolumeShelveTestJSON-1291269482 None] Deleting attachment 9061faef-9426-4cdc-8069-5df78c8b5a1d. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.569s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Deleted volume successfully. Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2af228cf-c966-4c4b-ba21-0176be62f5af tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-e4dd4eb4-f682-4709-a01b-2bf475e10791-delete_volume" released by "delete_volume" :: held 4.630s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-b5a17577-19a1-4e4c-b254-f52c4c063554-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-b5a17577-19a1-4e4c-b254-f52c4c063554-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a0dde4-5a25-4e1a-b262-d0cbf3f6360a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:19 devstack quobyte-client[83627]: System call of process 90516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554" returned: 0 in 0.617s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b5a17577-19a1-4e4c-b254-f52c4c063554" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-quobyte-b5a17577-19a1-4e4c-b254-f52c4c063554" released by "delete_volume" :: held 0.991s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Created reservations ['58335a9c-92a3-4cf9-af43-deec141c5c55', '4737aa83-d00f-40a7-867f-2c224c18e450', '024119e8-dbc0-4358-83f3-c84e515c1e19', '039393b9-7c75-4789-919e-f3d04eb3699d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.149s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Deleted volume successfully. Sep 26 17:36:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e2651ad6-b377-406e-aba3-d9722cf71c96 tempest-VolumesDeleteCascade-62816176 None] Lock "cinder-b5a17577-19a1-4e4c-b254-f52c4c063554-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=52,cinder:UPDATE=70,cinder:DELETE=9,cinder:INSERT=13 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=71,cinder:SELECT=56,cinder:DELETE=4,cinder:INSERT=19 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:36:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Flow 'volume_create_manager' (65ff314b-f7ee-4e84-8916-920b0f363ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac77f629-f349-4f4b-94f9-58ce72325f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac77f629-f349-4f4b-94f9-58ce72325f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-816257198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1918069-5c4b-4723-a481-274110491d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34e40b6426641049d9221815301ec8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:27Z,use_quota=True,user_id='241e04d1dbdc48a2a555fa9e8d4219bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d2218a-a529-436e-9df6-bc929e0a7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d2218a-a529-436e-9df6-bc929e0a7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5a8606-9011-44a6-8b15-4023267ec275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5a8606-9011-44a6-8b15-4023267ec275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1918069-5c4b-4723-a481-274110491d64', 'volume_name': 'volume-c1918069-5c4b-4723-a481-274110491d64', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6529a82-6fba-4be2-853f-7f0e0dc81623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6529a82-6fba-4be2-853f-7f0e0dc81623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc25196b-f3e5-4246-bcf4-8384600656fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:27 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Volume c1918069-5c4b-4723-a481-274110491d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1918069-5c4b-4723-a481-274110491d64', 'volume_size': 1} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-816257198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1918069-5c4b-4723-a481-274110491d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34e40b6426641049d9221815301ec8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:27Z,use_quota=True,user_id='241e04d1dbdc48a2a555fa9e8d4219bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Creating volume c1918069-5c4b-4723-a481-274110491d64 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:36:27 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:36:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:28 devstack quobyte-client[83627]: System call of process 90566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:28 devstack quobyte-client[83627]: System call of process 90566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:28 devstack quobyte-client[83627]: System call of process 90566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:28 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=33, name=volume-c1918069-5c4b-4723-a481-274110491d64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64 1073741824" returned: 0 in 0.488s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64" returned: 0 in 0.148s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc25196b-f3e5-4246-bcf4-8384600656fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1918069-5c4b-4723-a481-274110491d64', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9734b73-7efd-48a5-a0fd-ca57ef6b225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:28 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Volume volume-c1918069-5c4b-4723-a481-274110491d64 (c1918069-5c4b-4723-a481-274110491d64): created successfully Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9734b73-7efd-48a5-a0fd-ca57ef6b225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Flow 'volume_create_manager' (65ff314b-f7ee-4e84-8916-920b0f363ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e3057e45-79a2-43bc-bc9f-ffcb9df2807b tempest-VolumesTransfersV355Test-1820424839 None] Created volume successfully. Sep 26 17:36:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0be391bb-d57e-4f78-a812-2a4bcee72edd tempest-VolumesTransfersV355Test-1270082475 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0be391bb-d57e-4f78-a812-2a4bcee72edd tempest-VolumesTransfersV355Test-1270082475 None] Transfer volume completed successfully. Sep 26 17:36:31 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "cinder-c1918069-5c4b-4723-a481-274110491d64-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:31 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-c1918069-5c4b-4723-a481-274110491d64-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "cinder-quobyte-c1918069-5c4b-4723-a481-274110491d64" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-quobyte-c1918069-5c4b-4723-a481-274110491d64" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fac554-41d9-474f-9c41-dfc9984d5798]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:32 devstack quobyte-client[83627]: System call of process 90570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64" returned: 0 in 0.618s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c1918069-5c4b-4723-a481-274110491d64" returned: 0 in 0.326s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-quobyte-c1918069-5c4b-4723-a481-274110491d64" released by "delete_volume" :: held 1.141s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Created reservations ['5c3f3568-5738-4067-a938-d54a968dc856', 'a6c907bf-ba14-4279-b428-fe59f7264c8b', '474c198a-9e23-403b-8411-6a3957de9c1a', 'e0fceec8-bab3-43ad-aad2-6e394acf2cef'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.159s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:34 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Deleted volume successfully. Sep 26 17:36:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-233ddfa3-ec8a-4680-b979-5b86c49da8fe tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-c1918069-5c4b-4723-a481-274110491d64-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Flow 'volume_create_manager' (5d81e8f4-a832-4b64-bbf1-8d721594531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95fa545-082c-4bbd-8e49-d21982d394fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95fa545-082c-4bbd-8e49-d21982d394fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787709458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaa845-07d4-4fd9-8069-dcda95726fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34e40b6426641049d9221815301ec8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:35Z,use_quota=True,user_id='241e04d1dbdc48a2a555fa9e8d4219bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e9ca5d-b582-45a8-b5f6-a514eb1a13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e9ca5d-b582-45a8-b5f6-a514eb1a13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8af506d-8f92-4c2f-9099-71da8f01a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8af506d-8f92-4c2f-9099-71da8f01a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbaa845-07d4-4fd9-8069-dcda95726fb0', 'volume_name': 'volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8326e71-8bde-4498-ade1-d5b25167a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8326e71-8bde-4498-ade1-d5b25167a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181c2258-bf94-4f2d-98de-a17081fcb0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Volume dbbaa845-07d4-4fd9-8069-dcda95726fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0', 'volume_size': 1} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1787709458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaa845-07d4-4fd9-8069-dcda95726fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34e40b6426641049d9221815301ec8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:35Z,use_quota=True,user_id='241e04d1dbdc48a2a555fa9e8d4219bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Creating volume dbbaa845-07d4-4fd9-8069-dcda95726fb0 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:36:35 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:36:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:35 devstack quobyte-client[83627]: System call of process 90575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=34, name=volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 1073741824" returned: 0 in 0.650s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0" returned: 0 in 0.156s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181c2258-bf94-4f2d-98de-a17081fcb0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a034e5-a864-4fb0-b1ad-e0bc9fa11814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Volume volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 (dbbaa845-07d4-4fd9-8069-dcda95726fb0): created successfully Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a034e5-a864-4fb0-b1ad-e0bc9fa11814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Flow 'volume_create_manager' (5d81e8f4-a832-4b64-bbf1-8d721594531f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-42282dd0-41cb-4462-925b-060f420f581c tempest-VolumesTransfersV355Test-1820424839 None] Created volume successfully. Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "cinder-dbbaa845-07d4-4fd9-8069-dcda95726fb0-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-dbbaa845-07d4-4fd9-8069-dcda95726fb0-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:37 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "cinder-quobyte-dbbaa845-07d4-4fd9-8069-dcda95726fb0" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-quobyte-dbbaa845-07d4-4fd9-8069-dcda95726fb0" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6692a90-87e0-40dc-b5f1-f372d2c62b9f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:38 devstack quobyte-client[83627]: System call of process 90581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:38 devstack quobyte-client[83627]: System call of process 90581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:38 devstack quobyte-client[83627]: System call of process 90581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:38 devstack quobyte-client[83627]: System call of process 90581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0" returned: 0 in 0.509s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dbbaa845-07d4-4fd9-8069-dcda95726fb0" returned: 0 in 0.211s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-quobyte-dbbaa845-07d4-4fd9-8069-dcda95726fb0" released by "delete_volume" :: held 0.930s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Created reservations ['79217c7f-35b1-4991-be18-e55b8fa8aa9c', '6d339c42-b47d-48dd-ae45-ea7aeb243bc7', 'd500b981-93b6-4fbb-9bb7-8c11607f0cb2', '65244d46-f85a-4080-982c-0cec9218111e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.184s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:40 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:36:40 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Deleted volume successfully. Sep 26 17:36:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-609154be-3371-46ae-90e4-343ce61b424f tempest-VolumesTransfersV355Test-156523261 None] Lock "cinder-dbbaa845-07d4-4fd9-8069-dcda95726fb0-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:36:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Flow 'volume_create_manager' (9412c994-439b-49e5-b011-fdd537a12d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16857812-8a8c-40c8-8a61-fb9b792fefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16857812-8a8c-40c8-8a61-fb9b792fefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1305707563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37cbd8f-ff35-40bf-9300-d55d8178464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511241303c84e1dbed8a1fbf8e10cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:48Z,use_quota=True,user_id='1679991c255c4ffba4e371b606512cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e87278-dd0d-4493-a6ee-0c717c98ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e87278-dd0d-4493-a6ee-0c717c98ec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c40fd-965d-4294-a1e1-e44b4887b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c40fd-965d-4294-a1e1-e44b4887b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd37cbd8f-ff35-40bf-9300-d55d8178464b', 'volume_name': 'volume-d37cbd8f-ff35-40bf-9300-d55d8178464b', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4945fb33-293d-4b98-946b-2fa70855533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4945fb33-293d-4b98-946b-2fa70855533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2aea13-efdb-480a-9af7-c5d7bfc8f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:36:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Volume d37cbd8f-ff35-40bf-9300-d55d8178464b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d37cbd8f-ff35-40bf-9300-d55d8178464b', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 26 17:36:48 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Cloning d37cbd8f-ff35-40bf-9300-d55d8178464b from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 17:36:49 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 17:36:49 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Image download 20.69 MB at 20.69 MB/s Sep 26 17:36:49 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb54c9-024d-4018-ab24-28a44e15bda2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:50 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD Sep 26 17:36:50 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:36:53 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Sep 26 17:36:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD" returned: 0 in 4.275s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:53 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 is fetched for user 1679991c255c4ffba4e371b606512cc9. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 17:36:54 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7630a679-c2e4-4ff5-9c8b-38237fd02d14]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:55 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD Sep 26 17:36:55 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:36:57 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD" returned: 0 in 3.549s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1305707563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37cbd8f-ff35-40bf-9300-d55d8178464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511241303c84e1dbed8a1fbf8e10cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:36:48Z,use_quota=True,user_id='1679991c255c4ffba4e371b606512cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Creating volume d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:36:57 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:36:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:58 devstack quobyte-client[83627]: System call of process 90639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:36:58 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=35, name=volume-d37cbd8f-ff35-40bf-9300-d55d8178464b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 1073741824" returned: 0 in 0.407s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 0.134s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] <== create_volume: return (664ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Attempting download of b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume d37cbd8f-ff35-40bf-9300-d55d8178464b. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c2098f-864e-49cc-949f-4ebd6a02c4db]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_ojtod1go {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_ojtod1go" returned: 0 in 0.357s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_ojtod1go {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_ojtod1go" returned: 1 in 0.398s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_ojtod1go' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e513f-5586-4d38-a253-d106fe1fb687]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:36:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:00 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] b453c7ff-249a-4559-a968-e9bd0fbe8a12 was qcow2, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 17:37:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:00 devstack quobyte-client[83627]: System call of process 90662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:00 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=35, name=volume-d37cbd8f-ff35-40bf-9300-d55d8178464b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 1.404s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:01 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_c3z52h7xdevstack@QuobyteHD, size 112.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:37:01 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Converted 112.00 MB image at 77.04 MB/s Sep 26 17:37:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:01 devstack quobyte-client[83627]: System call of process 90705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 1G" returned: 0 in 0.254s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:02 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[575165b5-054d-4b66-a2d6-bbae3d03392f]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:02 devstack quobyte-client[83627]: System call of process 90710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:02 devstack quobyte-client[83627]: System call of process 90710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:02 devstack quobyte-client[83627]: System call of process 90710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 0.434s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 1 in 0.442s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Downloaded image b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume d37cbd8f-ff35-40bf-9300-d55d8178464b successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 for user 1679991c255c4ffba4e371b606512cc9 is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Marking volume d37cbd8f-ff35-40bf-9300-d55d8178464b as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Copying metadata from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 to d37cbd8f-ff35-40bf-9300-d55d8178464b. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Creating volume glance metadata for volume d37cbd8f-ff35-40bf-9300-d55d8178464b backed by image b453c7ff-249a-4559-a968-e9bd0fbe8a12 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2aea13-efdb-480a-9af7-c5d7bfc8f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37cbd8f-ff35-40bf-9300-d55d8178464b', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23da32d-41c2-4aa4-a917-8b278cb7a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:03 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Volume volume-d37cbd8f-ff35-40bf-9300-d55d8178464b (d37cbd8f-ff35-40bf-9300-d55d8178464b): created successfully Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23da32d-41c2-4aa4-a917-8b278cb7a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Flow 'volume_create_manager' (9412c994-439b-49e5-b011-fdd537a12d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-96973f8c-7764-4d2e-af36-666c08b583c2 tempest-VolumesExtendTest-2104571596 None] Created volume successfully. Sep 26 17:37:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322e937-192f-4189-8af7-1f9811c6cb0c]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:04 devstack quobyte-client[83627]: System call of process 90729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 0.921s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:06 devstack quobyte-client[83627]: System call of process 90757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 1 in 1.381s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:37:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 2G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:06 devstack quobyte-client[83627]: System call of process 90792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:06 devstack quobyte-client[83627]: System call of process 90792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:06 devstack quobyte-client[83627]: System call of process 90792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b 2G" returned: 0 in 0.515s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.175s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ec00773a-e02c-4f50-b706-91fb333af98a tempest-VolumesExtendTest-2104571596 None] Extend volume completed successfully. Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-d37cbd8f-ff35-40bf-9300-d55d8178464b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.713s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-d37cbd8f-ff35-40bf-9300-d55d8178464b-delete_volume" acquired by "delete_volume" :: waited 0.957s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:37:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-quobyte-d37cbd8f-ff35-40bf-9300-d55d8178464b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-d37cbd8f-ff35-40bf-9300-d55d8178464b" acquired by "delete_volume" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c1373-6422-44dc-8ac2-f2a265c802ad]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:12 devstack quobyte-client[83627]: System call of process 90842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:12 devstack quobyte-client[83627]: System call of process 90842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 1.294s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:13 devstack quobyte-client[83627]: System call of process 90855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:13 devstack quobyte-client[83627]: System call of process 90855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 1 in 1.199s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:37:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d37cbd8f-ff35-40bf-9300-d55d8178464b" returned: 0 in 0.244s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-d37cbd8f-ff35-40bf-9300-d55d8178464b" released by "delete_volume" :: held 3.349s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Created reservations ['4dbf4737-3b67-4980-873f-61c55a2f68c0', '46be2624-eb4a-4bf3-bfcd-22b132598d5d', '14d2c0bd-df86-4d57-ad83-e32f70028f6f', '6cf48696-bf10-4b34-b5f0-e7ace26cbc17'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.176s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:16 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:37:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Deleted volume successfully. Sep 26 17:37:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a2c0a76-6b0f-4e33-a598-79ae37ba8c02 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-d37cbd8f-ff35-40bf-9300-d55d8178464b-delete_volume" released by "delete_volume" :: held 7.546s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Flow 'volume_create_manager' (36ed93b7-3997-40cc-98e4-9a5032cc98cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09c986-e7ae-4300-a33d-c5b1a85e15b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09c986-e7ae-4300-a33d-c5b1a85e15b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1847627506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b99492b-90ab-4323-8a84-6cd77373ce80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511241303c84e1dbed8a1fbf8e10cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:18Z,use_quota=True,user_id='1679991c255c4ffba4e371b606512cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793dfb35-6c67-43be-a87d-37b8c32b61d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793dfb35-6c67-43be-a87d-37b8c32b61d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38e4435-b7e8-4b91-a9bc-ed51b8995167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38e4435-b7e8-4b91-a9bc-ed51b8995167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b99492b-90ab-4323-8a84-6cd77373ce80', 'volume_name': 'volume-3b99492b-90ab-4323-8a84-6cd77373ce80', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee54f5a-5433-4229-8604-0ce26bd63cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee54f5a-5433-4229-8604-0ce26bd63cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c292a13-f953-4bc3-b3cc-97ec376e8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:18 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Volume 3b99492b-90ab-4323-8a84-6cd77373ce80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b99492b-90ab-4323-8a84-6cd77373ce80', 'volume_size': 1} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1847627506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b99492b-90ab-4323-8a84-6cd77373ce80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511241303c84e1dbed8a1fbf8e10cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:18Z,use_quota=True,user_id='1679991c255c4ffba4e371b606512cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Creating volume 3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:37:18 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:37:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:18 devstack quobyte-client[83627]: System call of process 90886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:18 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=36, name=volume-3b99492b-90ab-4323-8a84-6cd77373ce80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 1073741824" returned: 0 in 0.860s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 0.189s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] <== create_volume: return (1204ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:37:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c292a13-f953-4bc3-b3cc-97ec376e8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b99492b-90ab-4323-8a84-6cd77373ce80', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e92ac83-0084-46f8-abc1-b0343bf753e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:20 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Volume volume-3b99492b-90ab-4323-8a84-6cd77373ce80 (3b99492b-90ab-4323-8a84-6cd77373ce80): created successfully Sep 26 17:37:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e92ac83-0084-46f8-abc1-b0343bf753e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:20 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Flow 'volume_create_manager' (36ed93b7-3997-40cc-98e4-9a5032cc98cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4e0df340-71f8-4637-b01c-915e390441c0 tempest-VolumesExtendTest-2104571596 None] Created volume successfully. Sep 26 17:37:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Creating offline snapshot 02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 of volume 3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:37:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[282e08a5-62fe-4906-a449-11e03f8ea79e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:23 devstack quobyte-client[83627]: System call of process 90892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:23 devstack quobyte-client[83627]: System call of process 90892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:23 devstack quobyte-client[83627]: System call of process 90892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 1.273s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:24 devstack quobyte-client[83627]: System call of process 90897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:24 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=37, name=volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 1G" returned: 0 in 0.578s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3b99492b-90ab-4323-8a84-6cd77373ce80 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:25 devstack quobyte-client[83627]: System call of process 90900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:25 devstack quobyte-client[83627]: System call of process 90900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img rebase -u -b volume-3b99492b-90ab-4323-8a84-6cd77373ce80 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.512s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:37:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.405s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.246s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.info" returned: 0 in 0.210s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.info" returned: 0 in 0.106s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a8320764-bda2-46a7-bf34-453e1ec5808d tempest-VolumesExtendTest-2104571596 None] Create snapshot completed successfully Sep 26 17:37:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4dd4ad-bf87-4461-9c6b-9ffae1b4eecd]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 0.645s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 2G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:29 devstack quobyte-client[83627]: System call of process 90911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:29 devstack quobyte-client[83627]: System call of process 90911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 2G" returned: 0 in 0.674s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.474s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:29 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=29,cinder:UPDATE=34,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:37:29 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=14,cinder:DELETE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:37:29 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0776cd07-f391-42a2-bb58-df8ebe0d7f14 tempest-VolumesExtendTest-2104571596 None] Extend volume completed successfully. Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-quobyte-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Deleting offline snapshot 02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 of volume 3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] snapshot_file for this snap is: volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[28355a42-bd6a-4248-829a-48722aedd283]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:31 devstack quobyte-client[83627]: System call of process 90914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:31 devstack quobyte-client[83627]: System call of process 90914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.495s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b99492b-90ab-4323-8a84-6cd77373ce80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f5d44d-c09d-4f11-93b3-6cd6aeb95219]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:31 devstack quobyte-client[83627]: System call of process 90917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 0.538s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:32 devstack quobyte-client[83627]: System call of process 90920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:32 devstack quobyte-client[83627]: System call of process 90920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:32 devstack quobyte-client[83627]: System call of process 90920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.570s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80.02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4" released by "_delete_snapshot" :: held 2.181s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" released by "delete_snapshot" :: held 2.213s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:33 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Created reservations ['432b99d4-961a-4be6-89ea-596a98e77b9c', 'db2dd3b5-0e28-4a53-a71b-03a54de67391', '52976f4f-52d5-42c0-8890-157ef6ad3bdc', '17e76622-550b-4172-82bd-448d10342fb4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:37:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Delete snapshot completed successfully. Sep 26 17:37:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d0b8ce9-7e56-4928-abe7-453e275c6629 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-02fa6f7e-fe2b-46e3-8588-4267cebc9ae4-delete_snapshot" released by "delete_snapshot" :: held 2.799s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-3b99492b-90ab-4323-8a84-6cd77373ce80-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-3b99492b-90ab-4323-8a84-6cd77373ce80-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" acquired by "delete_volume" :: waited 0.029s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f3ae9-e10f-4ecd-9b68-18483b73c2ff]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:35 devstack quobyte-client[83627]: System call of process 90924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 0.842s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-3b99492b-90ab-4323-8a84-6cd77373ce80" returned: 0 in 0.208s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-quobyte-3b99492b-90ab-4323-8a84-6cd77373ce80" released by "delete_volume" :: held 1.552s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Created reservations ['46e477b9-988b-49c3-b678-cd5368fff217', '221860b8-2bb9-4adb-addf-e4dd3ab3a6e4', 'c2e72b8a-d3e8-4c3f-9b9f-10d8ad3ad0d4', '65d13026-a9e9-4009-b095-87cdad91942e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.295s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:36 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:37:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Deleted volume successfully. Sep 26 17:37:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ea37eb71-d8aa-414d-895a-be23d574c863 tempest-VolumesExtendTest-2104571596 None] Lock "cinder-3b99492b-90ab-4323-8a84-6cd77373ce80-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (a26663a6-c92d-4eee-9f50-cdfcfe45b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f067c59-a1f8-45f2-ad79-21fdf22c80b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f067c59-a1f8-45f2-ad79-21fdf22c80b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957535563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddcebfc-8dae-4698-92c9-50756be51982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:43Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8689e01a-60ba-4853-99d4-d76746088f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8689e01a-60ba-4853-99d4-d76746088f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421efc1-2e9d-46f5-84d8-8e5b816886ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421efc1-2e9d-46f5-84d8-8e5b816886ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddcebfc-8dae-4698-92c9-50756be51982', 'volume_name': 'volume-bddcebfc-8dae-4698-92c9-50756be51982', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1343ae7-fa9f-45fe-ab9e-f0aa246a1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1343ae7-fa9f-45fe-ab9e-f0aa246a1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9fa884-29f0-4494-bf33-8d3c2b026d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Volume bddcebfc-8dae-4698-92c9-50756be51982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddcebfc-8dae-4698-92c9-50756be51982', 'volume_size': 1} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957535563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddcebfc-8dae-4698-92c9-50756be51982,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:43Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Creating volume bddcebfc-8dae-4698-92c9-50756be51982 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:37:43 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:37:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:43 devstack quobyte-client[83627]: System call of process 90943 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:43 devstack quobyte-client[83627]: System call of process 90943 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:43 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=39, name=volume-bddcebfc-8dae-4698-92c9-50756be51982, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982 1073741824" returned: 0 in 0.953s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982" returned: 0 in 0.348s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] <== create_volume: return (1557ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:37:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db9fa884-29f0-4494-bf33-8d3c2b026d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddcebfc-8dae-4698-92c9-50756be51982', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f41724-e218-42c5-8b24-e5171ccb5495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Volume volume-bddcebfc-8dae-4698-92c9-50756be51982 (bddcebfc-8dae-4698-92c9-50756be51982): created successfully Sep 26 17:37:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f41724-e218-42c5-8b24-e5171ccb5495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (a26663a6-c92d-4eee-9f50-cdfcfe45b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-17af58e4-8c94-4389-b556-91fe77b874a6 tempest-VolumesListTestJSON-1909457950 None] Created volume successfully. Sep 26 17:37:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (429f961a-0672-410a-88e5-fe4a7af74b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5ee5e6-63e6-45f1-91b8-44fe2e5c9d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5ee5e6-63e6-45f1-91b8-44fe2e5c9d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-709305944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9745b2-f36a-4579-8c42-fa0c04a743a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:47Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67a969e-9338-4151-a3f9-d17b0097cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67a969e-9338-4151-a3f9-d17b0097cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762579e6-d440-4a83-b11b-cbc89f872ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762579e6-d440-4a83-b11b-cbc89f872ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9745b2-f36a-4579-8c42-fa0c04a743a0', 'volume_name': 'volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5dd623-3481-4de5-a333-531e2ab7175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5dd623-3481-4de5-a333-531e2ab7175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8840b4-e0a6-404f-846b-7ce0322f5b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:47 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Volume 9e9745b2-f36a-4579-8c42-fa0c04a743a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0', 'volume_size': 1} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-709305944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9745b2-f36a-4579-8c42-fa0c04a743a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:47Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Creating volume 9e9745b2-f36a-4579-8c42-fa0c04a743a0 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:37:47 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:37:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:47 devstack quobyte-client[83627]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:47 devstack quobyte-client[83627]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:47 devstack quobyte-client[83627]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:47 devstack quobyte-client[83627]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:47 devstack quobyte-client[83627]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:47 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=40, name=volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 1073741824" returned: 0 in 0.539s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] <== create_volume: return (772ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8840b4-e0a6-404f-846b-7ce0322f5b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee7d132-284e-4ee7-8931-08b3236ef361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Volume volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 (9e9745b2-f36a-4579-8c42-fa0c04a743a0): created successfully Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee7d132-284e-4ee7-8931-08b3236ef361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (429f961a-0672-410a-88e5-fe4a7af74b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9c349cc0-4f2d-4d1a-b9f8-21836e4da88a tempest-VolumesListTestJSON-1909457950 None] Created volume successfully. Sep 26 17:37:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (565604e4-e923-4169-a975-142964fa2091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2609a6-c490-4163-b483-118ef5c7b38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2609a6-c490-4163-b483-118ef5c7b38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-607958027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ac11f5-33ad-40f6-961a-c6c726a7ebac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:50Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59e60e-992f-4d98-baa3-81e90d0753e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59e60e-992f-4d98-baa3-81e90d0753e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b813ae-7b51-4b3b-a4d2-f12b1569a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b813ae-7b51-4b3b-a4d2-f12b1569a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ac11f5-33ad-40f6-961a-c6c726a7ebac', 'volume_name': 'volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a9867-befe-4b42-90f1-ce1a18ade4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a9867-befe-4b42-90f1-ce1a18ade4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c34212-55fb-4541-b381-ae9f18a31085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Volume 50ac11f5-33ad-40f6-961a-c6c726a7ebac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac', 'volume_size': 1} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-607958027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ac11f5-33ad-40f6-961a-c6c726a7ebac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4bfcdf73f474245ba053f26f5fd2249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:37:50Z,use_quota=True,user_id='9bbbb34dae2e49d8b9db54b4ceb8a28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Creating volume 50ac11f5-33ad-40f6-961a-c6c726a7ebac {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:37:50 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:50 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=41, name=volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac 1073741824" returned: 0 in 0.423s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac" returned: 0 in 0.196s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] <== create_volume: return (701ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:37:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c34212-55fb-4541-b381-ae9f18a31085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6ea57-399f-46c3-bbda-1eb599fa9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:37:51 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Volume volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac (50ac11f5-33ad-40f6-961a-c6c726a7ebac): created successfully Sep 26 17:37:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6ea57-399f-46c3-bbda-1eb599fa9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:37:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Flow 'volume_create_manager' (565604e4-e923-4169-a975-142964fa2091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:37:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9ec4ac96-4a07-4f53-b859-ecd25deeb3ec tempest-VolumesListTestJSON-1909457950 None] Created volume successfully. Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-50ac11f5-33ad-40f6-961a-c6c726a7ebac-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-50ac11f5-33ad-40f6-961a-c6c726a7ebac-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-quobyte-50ac11f5-33ad-40f6-961a-c6c726a7ebac" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-50ac11f5-33ad-40f6-961a-c6c726a7ebac" acquired by "delete_volume" :: waited 0.042s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b529d1-7aab-4929-af3d-84876f8b34b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:56 devstack quobyte-client[83627]: System call of process 91032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:56 devstack quobyte-client[83627]: System call of process 91032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:37:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac" returned: 0 in 0.518s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-50ac11f5-33ad-40f6-961a-c6c726a7ebac" returned: 0 in 0.185s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-50ac11f5-33ad-40f6-961a-c6c726a7ebac" released by "delete_volume" :: held 1.032s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Created reservations ['93ee0558-045d-48b0-9af7-e3075607d476', '0c8afa3c-d356-4e0c-9f9e-7eabbc556a92', '6aa32b37-f680-4b7f-95d9-4a6bce2d072a', 'eca35ff9-ae88-40d2-a03a-cf187da54abe'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:37:57 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Deleted volume successfully. Sep 26 17:37:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-75aa4ae7-5ae1-4be8-a332-65553ed5937a tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-50ac11f5-33ad-40f6-961a-c6c726a7ebac-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-9e9745b2-f36a-4579-8c42-fa0c04a743a0-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-9e9745b2-f36a-4579-8c42-fa0c04a743a0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-quobyte-9e9745b2-f36a-4579-8c42-fa0c04a743a0" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-9e9745b2-f36a-4579-8c42-fa0c04a743a0" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[86baae2b-d42c-43b3-80ec-8a866249590e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0" returned: 0 in 0.533s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9e9745b2-f36a-4579-8c42-fa0c04a743a0" returned: 0 in 0.144s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-9e9745b2-f36a-4579-8c42-fa0c04a743a0" released by "delete_volume" :: held 0.967s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Created reservations ['19916432-8886-4fc5-9a5c-f8a12db5c6d8', '04f7a037-00b1-4d10-bc4b-cf9fd7ef8347', '645fb848-72e7-446f-9a78-d0c77846a1ae', 'ddf8fde7-bdac-4586-b009-1fe2893f0b73'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.133s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:37:59 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:37:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Deleted volume successfully. Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f0a4ead0-f45f-4ab9-8cec-7d1f01fcbffc tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-9e9745b2-f36a-4579-8c42-fa0c04a743a0-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-bddcebfc-8dae-4698-92c9-50756be51982-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-bddcebfc-8dae-4698-92c9-50756be51982-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:00 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "cinder-quobyte-bddcebfc-8dae-4698-92c9-50756be51982" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-bddcebfc-8dae-4698-92c9-50756be51982" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ffed6-6c87-4abc-b3e5-64c9a17e8785]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:01 devstack quobyte-client[83627]: System call of process 91043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982" returned: 0 in 0.462s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bddcebfc-8dae-4698-92c9-50756be51982" returned: 0 in 0.090s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-quobyte-bddcebfc-8dae-4698-92c9-50756be51982" released by "delete_volume" :: held 0.729s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Created reservations ['3f78c568-59af-4ec6-8d7f-dd80689f8288', '18307e3b-fc4a-40a6-abdf-1a5a8232b609', '5b281f14-cb58-4752-944b-46b72b3f5fac', 'e2a727ba-c798-491b-b7fc-2ddb2ace0362'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.119s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:01 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:38:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Deleted volume successfully. Sep 26 17:38:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-11ac8dcd-777e-49e0-9759-2c73b9ec2d02 tempest-VolumesListTestJSON-1909457950 None] Lock "cinder-bddcebfc-8dae-4698-92c9-50756be51982-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Flow 'volume_create_manager' (43687368-20b6-4d33-bd73-4e1b702961d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165f023a-0338-451b-8e58-dc7686e4d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165f023a-0338-451b-8e58-dc7686e4d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-502736656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1795121d-0a14-4099-87b4-f2b3028332c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae55e48390544359c6442fcd6ee93cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:05Z,use_quota=True,user_id='1362c2c6c01346a9826072cd3753ff7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf998f6-4d74-473b-97d9-c7aa9c4e22b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf998f6-4d74-473b-97d9-c7aa9c4e22b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e71063-d68f-468a-9157-f347312eb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e71063-d68f-468a-9157-f347312eb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1795121d-0a14-4099-87b4-f2b3028332c8', 'volume_name': 'volume-1795121d-0a14-4099-87b4-f2b3028332c8', 'volume_size': 2}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007d0b31-23b9-4697-b098-3b8451823eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007d0b31-23b9-4697-b098-3b8451823eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4da393-f24f-47d4-a8b7-4d20c89835df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:05 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume 1795121d-0a14-4099-87b4-f2b3028332c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1795121d-0a14-4099-87b4-f2b3028332c8', 'volume_size': 2} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-502736656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1795121d-0a14-4099-87b4-f2b3028332c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae55e48390544359c6442fcd6ee93cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:05Z,use_quota=True,user_id='1362c2c6c01346a9826072cd3753ff7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Creating volume 1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:38:05 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:38:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 2147483648 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:05 devstack quobyte-client[83627]: System call of process 91080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:05 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=42, name=volume-1795121d-0a14-4099-87b4-f2b3028332c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 2147483648" returned: 0 in 0.450s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] <== create_volume: return (625ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4da393-f24f-47d4-a8b7-4d20c89835df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1795121d-0a14-4099-87b4-f2b3028332c8', 'volume_size': 2}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26270cac-b38f-4ed8-9710-803b8ba95ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:06 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume volume-1795121d-0a14-4099-87b4-f2b3028332c8 (1795121d-0a14-4099-87b4-f2b3028332c8): created successfully Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26270cac-b38f-4ed8-9710-803b8ba95ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Flow 'volume_create_manager' (43687368-20b6-4d33-bd73-4e1b702961d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1bc57757-dad0-4be4-aa57-4b4efaddf109 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Created volume successfully. Sep 26 17:38:07 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Creating offline snapshot 46f46803-49f6-4caa-8b33-712fbe9f1b0a of volume 1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:38:07 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[03939911-7dfd-4184-b067-29e26821aa9c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8" returned: 0 in 0.459s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a 2G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:08 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=43, name=volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a 2G" returned: 0 in 0.313s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1795121d-0a14-4099-87b4-f2b3028332c8 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "qemu-img rebase -u -b volume-1795121d-0a14-4099-87b4-f2b3028332c8 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.212s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:38:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.138s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.234s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.info" returned: 0 in 0.308s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.info" returned: 0 in 0.133s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fdc71350-35cc-4bbd-ba01-d0e24a173b95 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Create snapshot completed successfully Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "cinder-46f46803-49f6-4caa-8b33-712fbe9f1b0a-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-46f46803-49f6-4caa-8b33-712fbe9f1b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "cinder-quobyte-46f46803-49f6-4caa-8b33-712fbe9f1b0a" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-46f46803-49f6-4caa-8b33-712fbe9f1b0a" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Deleting offline snapshot 46f46803-49f6-4caa-8b33-712fbe9f1b0a of volume 1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] snapshot_file for this snap is: volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c823d8d-820a-476e-ab3d-1c7c62510fa1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:11 devstack quobyte-client[83627]: System call of process 91107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:11 devstack quobyte-client[83627]: System call of process 91107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.499s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1795121d-0a14-4099-87b4-f2b3028332c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[63483526-c8af-4f18-b40a-dfa0e4a1679f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8" returned: 0 in 0.600s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:12 devstack quobyte-client[83627]: System call of process 91117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.240s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8.46f46803-49f6-4caa-8b33-712fbe9f1b0a" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-46f46803-49f6-4caa-8b33-712fbe9f1b0a" released by "_delete_snapshot" :: held 1.858s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" released by "delete_snapshot" :: held 1.923s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:13 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Created reservations ['41c2001f-48ce-4855-b1ef-e6e91bcff961', 'f6d6e795-f86c-4c5d-bca5-d696aa459c8a', 'fef5f7a6-61b2-434f-8ed0-fecc19f1ab1a', 'e22ca30d-7a83-4f83-a91c-d43a8ce26f19'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:38:13 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Delete snapshot completed successfully. Sep 26 17:38:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-210efc4a-0f08-41d1-99f6-e6135a5d7d12 tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-46f46803-49f6-4caa-8b33-712fbe9f1b0a-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "cinder-1795121d-0a14-4099-87b4-f2b3028332c8-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-1795121d-0a14-4099-87b4-f2b3028332c8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:14 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f6bf6-eaa8-4ef9-a266-384fa04e7201]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:15 devstack quobyte-client[83627]: System call of process 91132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:15 devstack quobyte-client[83627]: System call of process 91132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:15 devstack quobyte-client[83627]: System call of process 91132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8" returned: 0 in 0.540s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1795121d-0a14-4099-87b4-f2b3028332c8" returned: 0 in 0.134s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-quobyte-1795121d-0a14-4099-87b4-f2b3028332c8" released by "delete_volume" :: held 0.948s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:15 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Created reservations ['af90b929-ca35-4781-8145-2c0505029e89', '857ea265-ccbd-4750-a0bf-fafeb0e1723a', '5edfdad4-1fde-4481-b9b2-cfc7fa9f3ab6', '2657f145-98e5-400b-9989-7a5f15c37f05'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:38:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Deleted volume successfully. Sep 26 17:38:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-87e2b664-64bc-4bbb-9640-563d1063fb2c tempest-VolumesSnapshotNegativeTestJSON-2108973904 None] Lock "cinder-1795121d-0a14-4099-87b4-f2b3028332c8-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:38:26 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=40,cinder:INSERT=11,cinder:UPDATE=64,cinder:DELETE=6 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:38:26 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=41,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:38:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:28 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:38:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (6d02ba48-e84a-4a50-b865-a526a84a9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db85cb1-c8e9-4954-a218-fd8e20ee209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db85cb1-c8e9-4954-a218-fd8e20ee209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1317457810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e84b2e-9867-4288-b980-15f5994d400b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:28Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28e3de7-4857-44cd-a9bc-bbc20569a3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28e3de7-4857-44cd-a9bc-bbc20569a3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa047e9-dba9-43cb-b032-23324c768893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa047e9-dba9-43cb-b032-23324c768893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e84b2e-9867-4288-b980-15f5994d400b', 'volume_name': 'volume-53e84b2e-9867-4288-b980-15f5994d400b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9734f81c-2e1b-4ccd-9ac4-fb16a556e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9734f81c-2e1b-4ccd-9ac4-fb16a556e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0398869-d996-4898-b85a-1a55ec70d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:29 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Volume 53e84b2e-9867-4288-b980-15f5994d400b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e84b2e-9867-4288-b980-15f5994d400b', 'volume_size': 1} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1317457810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e84b2e-9867-4288-b980-15f5994d400b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:28Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Creating volume 53e84b2e-9867-4288-b980-15f5994d400b {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:38:29 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:38:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:29 devstack quobyte-client[83627]: System call of process 91154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:29 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=45, name=volume-53e84b2e-9867-4288-b980-15f5994d400b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b 1073741824" returned: 0 in 1.713s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:31 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Flow 'volume_create_manager' (e7922672-8579-4fbc-b216-29d18a18d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5889e65a-d791-45d8-adb8-78c1bc145011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b" returned: 0 in 0.796s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] <== create_volume: return (2593ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.625s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5889e65a-d791-45d8-adb8-78c1bc145011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1716951610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18671e4-f9e8-40e9-9d6c-826c4c63af8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bd72076a194d59b89547c98e042373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:29Z,use_quota=True,user_id='918fbbced82d428db6bc84a7ae105d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2332b48d-ef9b-4739-9e08-1b136d401ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2332b48d-ef9b-4739-9e08-1b136d401ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2408ac8-e7e7-40f5-97e7-e8f5011d1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2408ac8-e7e7-40f5-97e7-e8f5011d1a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18671e4-f9e8-40e9-9d6c-826c4c63af8d', 'volume_name': 'volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba272f-db0b-4c97-90c9-7cff4a91f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ba272f-db0b-4c97-90c9-7cff4a91f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc04525-402c-4f59-a3c0-4ce30c28a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume d18671e4-f9e8-40e9-9d6c-826c4c63af8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d', 'volume_size': 1} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1716951610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18671e4-f9e8-40e9-9d6c-826c4c63af8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bd72076a194d59b89547c98e042373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:38:29Z,use_quota=True,user_id='918fbbced82d428db6bc84a7ae105d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Creating volume d18671e4-f9e8-40e9-9d6c-826c4c63af8d {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:38:31 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:38:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:32 devstack quobyte-client[83627]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:38:32 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=46, name=volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:38:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0398869-d996-4898-b85a-1a55ec70d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e84b2e-9867-4288-b980-15f5994d400b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b0421c-2029-4f98-84d1-81d6c37f9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d 1073741824" returned: 0 in 0.682s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Volume volume-53e84b2e-9867-4288-b980-15f5994d400b (53e84b2e-9867-4288-b980-15f5994d400b): created successfully Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b0421c-2029-4f98-84d1-81d6c37f9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (6d02ba48-e84a-4a50-b865-a526a84a9581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" returned: 0 in 0.958s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] <== create_volume: return (1705ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f9397394-6704-491a-a831-c534fd44a386 tempest-AttachVolumeNegativeTest-922204878 None] Created volume successfully. Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc04525-402c-4f59-a3c0-4ce30c28a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ab7ff4-1e3c-4181-84c0-8ac015da838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:38:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d (d18671e4-f9e8-40e9-9d6c-826c4c63af8d): created successfully Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ab7ff4-1e3c-4181-84c0-8ac015da838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:38:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Flow 'volume_create_manager' (e7922672-8579-4fbc-b216-29d18a18d13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:38:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3d451eaf-4b21-4d66-914c-ac3e3aac2d68 tempest-AttachVolumeShelveTestJSON-1291269482 None] Created volume successfully. Sep 26 17:38:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:38:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:38:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d4f47-bfec-4ccc-9780-870b7d32aefb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:38:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:38:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b" returned: 0 in 0.629s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:38:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.729s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:38:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-53e84b2e-9867-4288-b980-15f5994d400b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f720062-7762-4d1b-a518-6bb93b8dd327', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:38:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:39 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-268b1e38-f2b1-4630-af12-46b1741b2525 req-11fdda48-6328-448a-a8e1-3af70e86a20c tempest-AttachVolumeNegativeTest-922204878 None] attachment_update completed successfully. Sep 26 17:38:49 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:38:49 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:38:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b6da9165-0692-4136-a1e0-b3b5e620bfb2 req-e3e77f3a-8f95-46e3-8014-7ae17fcb89e4 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b6da9165-0692-4136-a1e0-b3b5e620bfb2 req-e3e77f3a-8f95-46e3-8014-7ae17fcb89e4 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:38:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b6da9165-0692-4136-a1e0-b3b5e620bfb2 req-e3e77f3a-8f95-46e3-8014-7ae17fcb89e4 tempest-AttachVolumeShelveTestJSON-1291269482 None] No connector for attachment d76b157b-0154-438c-b241-c38ee9612993; skipping storage backend terminate_connection call. {{(pid=83624) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 26 17:38:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b6da9165-0692-4136-a1e0-b3b5e620bfb2 req-e3e77f3a-8f95-46e3-8014-7ae17fcb89e4 tempest-AttachVolumeShelveTestJSON-1291269482 None] Deleting attachment d76b157b-0154-438c-b241-c38ee9612993. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:39:05 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:39:05 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:39:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:39:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.481s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:39:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:39:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:39:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Flow 'volume_create_manager' (22f7710d-aac5-4710-adb4-231c43e02641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf8ab85-4d42-4610-9438-e9a17ee1fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf8ab85-4d42-4610-9438-e9a17ee1fbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1996240848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb36ad7-471f-428b-9016-355482ee5b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c1dee4763441918b16a5699da256bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:39:47Z,use_quota=True,user_id='cc9d77e4ec674878bae443f8819bd3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45dd3bf-5d69-4911-8460-703d28b09b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45dd3bf-5d69-4911-8460-703d28b09b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e53c8ce-1fd9-4cf3-8542-e3ca959c4354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e53c8ce-1fd9-4cf3-8542-e3ca959c4354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb36ad7-471f-428b-9016-355482ee5b30', 'volume_name': 'volume-1eb36ad7-471f-428b-9016-355482ee5b30', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31434cb-4978-41b6-8ace-a3ee3abf6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31434cb-4978-41b6-8ace-a3ee3abf6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcf2b69-4829-4b0e-8963-dd8860773633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Volume 1eb36ad7-471f-428b-9016-355482ee5b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb36ad7-471f-428b-9016-355482ee5b30', 'volume_size': 1} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1996240848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb36ad7-471f-428b-9016-355482ee5b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c1dee4763441918b16a5699da256bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:39:47Z,use_quota=True,user_id='cc9d77e4ec674878bae443f8819bd3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Creating volume 1eb36ad7-471f-428b-9016-355482ee5b30 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:39:48 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:39:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:39:49 devstack quobyte-client[83627]: System call of process 92042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:39:49 devstack quobyte-client[83627]: System call of process 92042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:39:49 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=47, name=volume-1eb36ad7-471f-428b-9016-355482ee5b30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:39:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 1073741824" returned: 0 in 1.429s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:39:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:39:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30" returned: 0 in 0.170s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:39:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] <== create_volume: return (1830ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:39:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:39:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcf2b69-4829-4b0e-8963-dd8860773633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb36ad7-471f-428b-9016-355482ee5b30', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19508fb9-e5c1-434d-8df0-1f4b75528762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:39:51 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Volume volume-1eb36ad7-471f-428b-9016-355482ee5b30 (1eb36ad7-471f-428b-9016-355482ee5b30): created successfully Sep 26 17:39:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19508fb9-e5c1-434d-8df0-1f4b75528762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:39:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Flow 'volume_create_manager' (22f7710d-aac5-4710-adb4-231c43e02641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:39:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-50389796-ef74-4ddc-9560-6efc15644877 tempest-TestMinimumBasicScenario-1832997660 None] Created volume successfully. Sep 26 17:39:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:39:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:39:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da7d9c-b204-405e-8662-0a31c0dcff25]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:39:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:39:59 devstack quobyte-client[83627]: System call of process 92130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:39:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30" returned: 0 in 0.631s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:39:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.752s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:39:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-1eb36ad7-471f-428b-9016-355482ee5b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3804c10-027e-4531-ac59-2bb4f6c2e206', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:39:59 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:39:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-17ba4e8a-c527-4382-a430-4ac6d9a8d671 req-ccb031cd-692e-4375-aeb6-195740dedeb2 tempest-TestMinimumBasicScenario-1832997660 None] attachment_update completed successfully. Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:40:09 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:40:10 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:40:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.685s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:40:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:40:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:40:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:41:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-c9dc16f2-dc77-464a-bbce-ec930fc89302 req-cbe9ab08-e197-4ccd-b534-d9cae52ac961 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:41:09 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-c9dc16f2-dc77-464a-bbce-ec930fc89302 req-cbe9ab08-e197-4ccd-b534-d9cae52ac961 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:41:09 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-c9dc16f2-dc77-464a-bbce-ec930fc89302 req-cbe9ab08-e197-4ccd-b534-d9cae52ac961 tempest-AttachVolumeNegativeTest-922204878 None] Terminate volume connection completed successfully. Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-c9dc16f2-dc77-464a-bbce-ec930fc89302 req-cbe9ab08-e197-4ccd-b534-d9cae52ac961 tempest-AttachVolumeNegativeTest-922204878 None] Deleting attachment 2f720062-7762-4d1b-a518-6bb93b8dd327. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.083s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "cinder-d18671e4-f9e8-40e9-9d6c-826c4c63af8d-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-d18671e4-f9e8-40e9-9d6c-826c4c63af8d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:41:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "cinder-quobyte-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-quobyte-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc267f-08e1-4645-8347-9daa0832f33f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:41:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" returned: 0 in 0.468s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-quobyte-d18671e4-f9e8-40e9-9d6c-826c4c63af8d" released by "delete_volume" :: held 0.762s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Created reservations ['68f2c20c-e68a-4040-bbcc-fffa97107fa9', '99b943b4-4fd7-48fb-a4b6-cdfc94e880e0', '087cb84a-4ef5-4e7b-b094-e26e925193d5', '4af434f0-b54e-4d81-9c93-e3d87510518e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.181s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:41:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.495s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:14 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:41:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Deleted volume successfully. Sep 26 17:41:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "cinder-d790dc05-c854-4406-abd9-f1bde6ed1c7b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:41:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-d790dc05-c854-4406-abd9-f1bde6ed1c7b-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:41:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a259c27-7c55-4498-9bd3-c2f79fc7cc07 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-d18671e4-f9e8-40e9-9d6c-826c4c63af8d-delete_volume" released by "delete_volume" :: held 4.095s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:41:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:41:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "cinder-quobyte-d790dc05-c854-4406-abd9-f1bde6ed1c7b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:41:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-quobyte-d790dc05-c854-4406-abd9-f1bde6ed1c7b" acquired by "delete_volume" :: waited 0.022s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:41:16 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8a107-7850-4d6b-9548-0b8cef564f17]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:41:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:16 devstack quobyte-client[83627]: System call of process 92560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:41:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b" returned: 0 in 0.641s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d790dc05-c854-4406-abd9-f1bde6ed1c7b" returned: 0 in 0.170s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-quobyte-d790dc05-c854-4406-abd9-f1bde6ed1c7b" released by "delete_volume" :: held 1.073s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:41:17 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Created reservations ['1bdc93a5-0bf3-4cea-aabc-4e513102250f', '4b44d62f-598a-40bf-95a5-f14509132cbf', '06303ed5-e957-4616-aeb0-f460558afb08', '1deeb624-9757-4013-91f7-cea0fc4008dd'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.507s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:41:18 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:41:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Deleted volume successfully. Sep 26 17:41:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1794479e-cf5f-4d24-a470-fab3c1f7a695 tempest-AttachVolumeShelveTestJSON-1291269482 None] Lock "cinder-d790dc05-c854-4406-abd9-f1bde6ed1c7b-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:41:27 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:41:29 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.261s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:42:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:42:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:43:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b2c762c0-fff4-4779-af78-fac9765c0d51 req-d3ae7c1c-5908-4865-a036-e56d3ed9d482 tempest-TestMinimumBasicScenario-1832997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b2c762c0-fff4-4779-af78-fac9765c0d51 req-d3ae7c1c-5908-4865-a036-e56d3ed9d482 tempest-TestMinimumBasicScenario-1832997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:01 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-b2c762c0-fff4-4779-af78-fac9765c0d51 req-d3ae7c1c-5908-4865-a036-e56d3ed9d482 tempest-TestMinimumBasicScenario-1832997660 None] Terminate volume connection completed successfully. Sep 26 17:43:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b2c762c0-fff4-4779-af78-fac9765c0d51 req-d3ae7c1c-5908-4865-a036-e56d3ed9d482 tempest-TestMinimumBasicScenario-1832997660 None] Deleting attachment e3804c10-027e-4531-ac59-2bb4f6c2e206. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "cinder-1eb36ad7-471f-428b-9016-355482ee5b30-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "cinder-1eb36ad7-471f-428b-9016-355482ee5b30-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:43:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "cinder-quobyte-1eb36ad7-471f-428b-9016-355482ee5b30" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "cinder-quobyte-1eb36ad7-471f-428b-9016-355482ee5b30" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf09b1c-cef0-47a1-876b-af023e0f13b4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:43:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30" returned: 0 in 0.487s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1eb36ad7-471f-428b-9016-355482ee5b30" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "cinder-quobyte-1eb36ad7-471f-428b-9016-355482ee5b30" released by "delete_volume" :: held 0.825s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Created reservations ['8fe32528-fb3e-45d5-b8ff-d754d22f9cc2', '14481a6c-23ac-4d8a-9820-87384fd19b5a', '8dd73594-1927-4deb-b32e-7e7d20f54b84', '38ba2c28-adf7-49af-b9fd-2d844ec410a5'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:43:05 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Deleted volume successfully. Sep 26 17:43:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a191ba5d-aa54-49ce-8c9d-70e7b1c27961 tempest-TestMinimumBasicScenario-1832997660 None] Lock "cinder-1eb36ad7-471f-428b-9016-355482ee5b30-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.093s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.170s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:43:14 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (eac24a65-a602-4840-b4d3-4e88bf49e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a688a03c-569f-4a2d-bac9-4b6d4feae4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a688a03c-569f-4a2d-bac9-4b6d4feae4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1805756294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd51eb4-ff37-4b77-abc7-39eadaecffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:43:14Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6797795-3222-4430-9177-91845a083191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6797795-3222-4430-9177-91845a083191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20385f91-7e16-42f0-ad75-99b22bd1afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20385f91-7e16-42f0-ad75-99b22bd1afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd51eb4-ff37-4b77-abc7-39eadaecffde', 'volume_name': 'volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c3c76-25f9-41e6-a99f-1c8b80e14aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c3c76-25f9-41e6-a99f-1c8b80e14aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc86655-4f9e-4ef5-9955-b5f8d6ee1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:14 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Volume 8fd51eb4-ff37-4b77-abc7-39eadaecffde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde', 'volume_size': 1} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1805756294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd51eb4-ff37-4b77-abc7-39eadaecffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:43:14Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Creating volume 8fd51eb4-ff37-4b77-abc7-39eadaecffde {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:43:14 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:14 devstack quobyte-client[83627]: System call of process 93137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:43:14 devstack quobyte-client[83627]: System call of process 93137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:43:14 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=48, name=volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde 1073741824" returned: 0 in 0.551s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde" returned: 0 in 0.163s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] <== create_volume: return (882ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc86655-4f9e-4ef5-9955-b5f8d6ee1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628edffb-e833-4fa6-b2d9-58d50603323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:15 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Volume volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde (8fd51eb4-ff37-4b77-abc7-39eadaecffde): created successfully Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628edffb-e833-4fa6-b2d9-58d50603323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (eac24a65-a602-4840-b4d3-4e88bf49e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:43:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6acef781-412d-44ea-b60a-2ca64e7a399a tempest-AttachVolumeNegativeTest-922204878 None] Created volume successfully. Sep 26 17:43:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca3af0-6e78-4900-aab3-1e98a1f4fe32]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:43:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde" returned: 0 in 0.803s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fdc8838-e1b3-4b01-a132-df059c1ee3e4', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:43:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-8fa2153a-de37-4014-9d8f-66f425906a40 req-ae218018-cc01-4c90-9e02-2752283b5ac5 tempest-AttachVolumeNegativeTest-922204878 None] attachment_update completed successfully. Sep 26 17:43:33 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:43:33 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:43:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (bcf7b7a9-ba29-44a5-a919-0184ccfcd0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f21654a-5c8f-4015-a03a-3aa8d411c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f21654a-5c8f-4015-a03a-3aa8d411c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396533096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af168c31-b727-4b97-bcf7-4d7793d145f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:43:34Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bb45da-9532-4e9d-8efc-6ca3ef7b0a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bb45da-9532-4e9d-8efc-6ca3ef7b0a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705c07f2-732d-4515-8cd2-47fcede0d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705c07f2-732d-4515-8cd2-47fcede0d613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af168c31-b727-4b97-bcf7-4d7793d145f1', 'volume_name': 'volume-af168c31-b727-4b97-bcf7-4d7793d145f1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11493853-ab00-4960-b287-0c03b0c18bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11493853-ab00-4960-b287-0c03b0c18bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ceee8-372b-4950-82de-2806559cae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:34 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Volume af168c31-b727-4b97-bcf7-4d7793d145f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af168c31-b727-4b97-bcf7-4d7793d145f1', 'volume_size': 1} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396533096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af168c31-b727-4b97-bcf7-4d7793d145f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:43:34Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Creating volume af168c31-b727-4b97-bcf7-4d7793d145f1 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:43:34 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:43:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:34 devstack quobyte-client[83627]: System call of process 93577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:43:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=49, name=volume-af168c31-b727-4b97-bcf7-4d7793d145f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:43:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 1073741824" returned: 0 in 0.494s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1" returned: 0 in 0.308s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] <== create_volume: return (1000ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:43:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ceee8-372b-4950-82de-2806559cae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af168c31-b727-4b97-bcf7-4d7793d145f1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58092cf-8053-46a9-9c9e-3aaee4656797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:43:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Volume volume-af168c31-b727-4b97-bcf7-4d7793d145f1 (af168c31-b727-4b97-bcf7-4d7793d145f1): created successfully Sep 26 17:43:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58092cf-8053-46a9-9c9e-3aaee4656797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:43:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (bcf7b7a9-ba29-44a5-a919-0184ccfcd0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:43:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-227fa420-602b-40ed-9316-fdc569b9fb13 tempest-AttachVolumeTestJSON-361234456 None] Created volume successfully. Sep 26 17:43:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:43:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:43:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a0c9e-17b7-49f7-9a3e-6557fa195d4a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:43:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:43:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1" returned: 0 in 0.545s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:43:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.626s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:43:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-af168c31-b727-4b97-bcf7-4d7793d145f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5c16eaa-843d-4fb2-a1b5-598222a67e1d', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:43:41 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-4ca1ddfd-391c-463c-a94a-a5494559a919 req-1f6d93d3-11e4-4d8f-b73f-b43d7be9efe7 tempest-AttachVolumeTestJSON-361234456 None] attachment_update completed successfully. Sep 26 17:43:51 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:43:51 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:43:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-4ab77c08-bc5b-4ae3-812e-f51ed1cbd2ea req-9193ce5a-71d8-49b7-8e1f-ba6f97e6a8e2 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-4ab77c08-bc5b-4ae3-812e-f51ed1cbd2ea req-9193ce5a-71d8-49b7-8e1f-ba6f97e6a8e2 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:43:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-4ab77c08-bc5b-4ae3-812e-f51ed1cbd2ea req-9193ce5a-71d8-49b7-8e1f-ba6f97e6a8e2 tempest-AttachVolumeNegativeTest-922204878 None] Terminate volume connection completed successfully. Sep 26 17:43:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-4ab77c08-bc5b-4ae3-812e-f51ed1cbd2ea req-9193ce5a-71d8-49b7-8e1f-ba6f97e6a8e2 tempest-AttachVolumeNegativeTest-922204878 None] Deleting attachment 2fdc8838-e1b3-4b01-a132-df059c1ee3e4. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:44:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:44:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.174s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:44:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:44:11 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Flow 'volume_create_manager' (7d5f767a-20bc-4fc8-9214-fca3822ac70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc1a3b-9693-45e3-a19c-b5496ad5e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc1a3b-9693-45e3-a19c-b5496ad5e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1758262490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364641ad-1d70-4678-b749-f1b2ce6a1637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d79006c1204f72bb595909a84dbed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:44:10Z,use_quota=True,user_id='7a2e2861aa0045658677a8b95e6692ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f6bf5-7d95-4010-9cf2-a28caba9a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f6bf5-7d95-4010-9cf2-a28caba9a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f6bb2e-a3fb-48f5-87e3-555cec73bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:12 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 17:44:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f6bb2e-a3fb-48f5-87e3-555cec73bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '364641ad-1d70-4678-b749-f1b2ce6a1637', 'volume_name': 'volume-364641ad-1d70-4678-b749-f1b2ce6a1637', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65be547-3cb0-4c73-9d4d-cb219ef0ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65be547-3cb0-4c73-9d4d-cb219ef0ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a78e53-8082-4f95-bd72-8658e1a9200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:13 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Volume 364641ad-1d70-4678-b749-f1b2ce6a1637: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-364641ad-1d70-4678-b749-f1b2ce6a1637', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 26 17:44:13 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Cloning 364641ad-1d70-4678-b749-f1b2ce6a1637 from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 17:44:14 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 17:44:14 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Image download 20.69 MB at 20.69 MB/s Sep 26 17:44:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d82c4a-5b19-4fe1-9fb5-b7bda2038dad]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:14 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD Sep 26 17:44:14 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:44:17 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 26 17:44:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD" returned: 0 in 3.249s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:17 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 is fetched for user 7a2e2861aa0045658677a8b95e6692ff. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 17:44:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af04305-ddab-4f1e-a9d3-1c372e1b0336]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:18 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD Sep 26 17:44:18 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:44:20 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD" returned: 0 in 2.513s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1758262490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364641ad-1d70-4678-b749-f1b2ce6a1637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d79006c1204f72bb595909a84dbed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:44:10Z,use_quota=True,user_id='7a2e2861aa0045658677a8b95e6692ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Creating volume 364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:44:20 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:44:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:20 devstack quobyte-client[83627]: System call of process 94304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:20 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=50, name=volume-364641ad-1d70-4678-b749-f1b2ce6a1637, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 1073741824" returned: 0 in 0.368s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 0.199s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Attempting download of b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume 364641ad-1d70-4678-b749-f1b2ce6a1637. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db02f5-d87a-48b8-b287-4a4a8a828992]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_beddj5qn {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_beddj5qn" returned: 0 in 0.354s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_beddj5qn {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_beddj5qn" returned: 1 in 0.432s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b453c7ff-249a-4559-a968-e9bd0fbe8a12_beddj5qn' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b93513-1420-41c6-9c29-5cdfe43835f9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] b453c7ff-249a-4559-a968-e9bd0fbe8a12 was qcow2, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 17:44:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:23 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=50, name=volume-364641ad-1d70-4678-b749-f1b2ce6a1637, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 1.141s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b453c7ff-249a-4559-a968-e9bd0fbe8a12_5gks5wqsdevstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:44:24 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Converted 112.00 MB image at 94.09 MB/s Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:24 devstack quobyte-client[83627]: System call of process 94324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 1G" returned: 0 in 0.173s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c64fa8b-3fbe-4daa-9f4c-ca4fbf0183e8]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:24 devstack quobyte-client[83627]: System call of process 94327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:24 devstack quobyte-client[83627]: System call of process 94327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 0.495s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:25 devstack quobyte-client[83627]: System call of process 94329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:25 devstack quobyte-client[83627]: System call of process 94329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:25 devstack quobyte-client[83627]: System call of process 94329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 1 in 0.669s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Downloaded image b453c7ff-249a-4559-a968-e9bd0fbe8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}])) to volume 364641ad-1d70-4678-b749-f1b2ce6a1637 successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Temporary image b453c7ff-249a-4559-a968-e9bd0fbe8a12 for user 7a2e2861aa0045658677a8b95e6692ff is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Marking volume 364641ad-1d70-4678-b749-f1b2ce6a1637 as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Copying metadata from image b453c7ff-249a-4559-a968-e9bd0fbe8a12 to 364641ad-1d70-4678-b749-f1b2ce6a1637. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 17:44:25 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Creating volume glance metadata for volume 364641ad-1d70-4678-b749-f1b2ce6a1637 backed by image b453c7ff-249a-4559-a968-e9bd0fbe8a12 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 17:44:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a78e53-8082-4f95-bd72-8658e1a9200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364641ad-1d70-4678-b749-f1b2ce6a1637', 'volume_size': 1, 'image_id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c1079682e2d4ababf73dda259771919', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b453c7ff-249a-4559-a968-e9bd0fbe8a12', 'created_at': datetime.datetime(2025, 9, 26, 15, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b453c7ff-249a-4559-a968-e9bd0fbe8a12/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af0c4e-1f44-4bb9-b717-d4fc3219d28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:44:26 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Volume volume-364641ad-1d70-4678-b749-f1b2ce6a1637 (364641ad-1d70-4678-b749-f1b2ce6a1637): created successfully Sep 26 17:44:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af0c4e-1f44-4bb9-b717-d4fc3219d28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:44:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Flow 'volume_create_manager' (7d5f767a-20bc-4fc8-9214-fca3822ac70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:44:26 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c251b66d-acf0-4bfd-ba45-91d8fcc8e69e tempest-TestShelveInstance-1707170798 None] Created volume successfully. Sep 26 17:44:36 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=6 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:44:36 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:44:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:44:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:44:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2625f2-a0b6-4e25-82b3-06372f2f80e3]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:44:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:43 devstack quobyte-client[83627]: System call of process 94414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:43 devstack quobyte-client[83627]: System call of process 94414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:43 devstack quobyte-client[83627]: System call of process 94414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 1.658s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:44:45 devstack quobyte-client[83627]: System call of process 94433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:44:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 1 in 1.492s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:44:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:44:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.776s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:44:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-364641ad-1d70-4678-b749-f1b2ce6a1637', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '328923bc-5bd2-45be-a4b3-bf7c7b8e6489', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:44:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:44:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-c961b491-18b8-42bd-92e1-4dfca70d2f4e req-a2061d43-6629-45af-90bc-eb33dfbbb739 tempest-TestShelveInstance-1707170798 None] attachment_update completed successfully. Sep 26 17:44:56 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:44:56 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.250s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:45:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:45:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-9ff2ac57-beb2-4e2d-827c-9bb4c27ffa27 req-8e02591c-eeee-46d9-a8ba-c3b915b1c32a tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:45:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-9ff2ac57-beb2-4e2d-827c-9bb4c27ffa27 req-8e02591c-eeee-46d9-a8ba-c3b915b1c32a tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:45:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-9ff2ac57-beb2-4e2d-827c-9bb4c27ffa27 req-8e02591c-eeee-46d9-a8ba-c3b915b1c32a tempest-AttachVolumeTestJSON-361234456 None] Terminate volume connection completed successfully. Sep 26 17:45:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-9ff2ac57-beb2-4e2d-827c-9bb4c27ffa27 req-8e02591c-eeee-46d9-a8ba-c3b915b1c32a tempest-AttachVolumeTestJSON-361234456 None] Deleting attachment b5c16eaa-843d-4fb2-a1b5-598222a67e1d. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:45:55 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:45:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:45:57 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:45:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (81deabea-97d5-4095-9981-75d4844b9a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:45:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833e7e24-4c97-409d-9449-c91e2caa8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833e7e24-4c97-409d-9449-c91e2caa8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2045934675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:45:58Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61762cd9-4fcc-4088-b391-634835612e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61762cd9-4fcc-4088-b391-634835612e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5096921a-92de-459a-90c0-56ce82263cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5096921a-92de-459a-90c0-56ce82263cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492', 'volume_name': 'volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9b5402-0b4d-4815-9e98-a4fb27cd82bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9b5402-0b4d-4815-9e98-a4fb27cd82bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb10c4d1-8989-48c6-94fb-291e588da703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:58 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Volume 8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492', 'volume_size': 1} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2045934675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b25b039a054867aa6dd9357da5e075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:45:58Z,use_quota=True,user_id='bc2eb5900bf34ada8c25c30a85a1ea2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Creating volume 8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:45:58 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:45:58 devstack quobyte-client[83627]: System call of process 94759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:45:58 devstack quobyte-client[83627]: System call of process 94759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:45:58 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=51, name=volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 1073741824" returned: 0 in 0.583s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:45:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" returned: 0 in 0.202s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] <== create_volume: return (1050ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb10c4d1-8989-48c6-94fb-291e588da703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c62bb6-ae90-40c5-859a-6f1ebf2b39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:45:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Volume volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 (8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492): created successfully Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c62bb6-ae90-40c5-859a-6f1ebf2b39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:45:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Flow 'volume_create_manager' (81deabea-97d5-4095-9981-75d4844b9a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:45:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fe3d055f-0a62-4f50-b35b-61a3e93522ef tempest-AttachVolumeNegativeTest-922204878 None] Created volume successfully. Sep 26 17:46:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:46:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:46:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0dcf44-93fe-44e6-82ed-bc8e6142b3ed]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:46:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:06 devstack quobyte-client[83627]: System call of process 94799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:46:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" returned: 0 in 0.648s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:46:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cc3bc85-ed95-4c06-9ff6-ea86c542c533', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:46:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-d0d402ea-bea2-438a-abec-7d38527c7cdb req-5683268e-367a-4eed-a395-b70705032cea tempest-AttachVolumeNegativeTest-922204878 None] attachment_update completed successfully. Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.255s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:46:16 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:46:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:46:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-923d2572-4040-4504-b09d-8e5a7084cf80 req-38dca564-83f8-497c-8dc3-b70af39a4429 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-923d2572-4040-4504-b09d-8e5a7084cf80 req-38dca564-83f8-497c-8dc3-b70af39a4429 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:24 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-923d2572-4040-4504-b09d-8e5a7084cf80 req-38dca564-83f8-497c-8dc3-b70af39a4429 tempest-TestShelveInstance-1707170798 None] Terminate volume connection completed successfully. Sep 26 17:46:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-923d2572-4040-4504-b09d-8e5a7084cf80 req-38dca564-83f8-497c-8dc3-b70af39a4429 tempest-TestShelveInstance-1707170798 None] Deleting attachment 328923bc-5bd2-45be-a4b3-bf7c7b8e6489. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:46:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:46:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:46:32 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c95c308-716c-47d2-a5e2-8ae45e7c2c51]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:46:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:33 devstack quobyte-client[83627]: System call of process 94994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:46:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 0.464s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 1 in 0.393s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:46:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.038s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:46:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-364641ad-1d70-4678-b749-f1b2ce6a1637', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98699f43-6b07-44e4-bb0d-e6ae1a1f813f', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:46:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-fa2a502c-5338-4a4b-8b2f-e5d7abe610d1 req-40b72a8f-4c1e-4419-8d1d-f5a6f5bef986 tempest-TestShelveInstance-1707170798 None] attachment_update completed successfully. Sep 26 17:46:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-0af4382b-fb14-4bbf-97d8-a4ff6c96c968 req-5e6f5cca-6826-4a08-9039-15dbe8a1281f tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-0af4382b-fb14-4bbf-97d8-a4ff6c96c968 req-5e6f5cca-6826-4a08-9039-15dbe8a1281f tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-0af4382b-fb14-4bbf-97d8-a4ff6c96c968 req-5e6f5cca-6826-4a08-9039-15dbe8a1281f tempest-AttachVolumeNegativeTest-922204878 None] Terminate volume connection completed successfully. Sep 26 17:46:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-0af4382b-fb14-4bbf-97d8-a4ff6c96c968 req-5e6f5cca-6826-4a08-9039-15dbe8a1281f tempest-AttachVolumeNegativeTest-922204878 None] Deleting attachment 5cc3bc85-ed95-4c06-9ff6-ea86c542c533. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:46:44 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:46:48 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:46:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-quobyte-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" acquired by "delete_volume" :: waited 0.091s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4426372-0316-4c37-b935-ce779defa241]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:46:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" returned: 0 in 0.760s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" returned: 0 in 0.153s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492" released by "delete_volume" :: held 1.129s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Created reservations ['21ca499d-85cd-4cfd-9f9f-7b5b74234cb7', '7e7cdb0b-eee3-4517-a9aa-0abac356c6ea', 'e6a5c387-b54f-43fd-8c68-bf21060d7a8e', '7759c0a2-ed32-42b6-a983-75a5238bb799'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:46:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.121s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:46:57 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Deleted volume successfully. Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1ce7109d-ae94-453d-bc56-664335501aad tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-8f599c0d-82af-4fcb-b1a1-4f4f9c5d8492-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-8fd51eb4-ff37-4b77-abc7-39eadaecffde-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:46:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-8fd51eb4-ff37-4b77-abc7-39eadaecffde-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:46:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:46:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-quobyte-8fd51eb4-ff37-4b77-abc7-39eadaecffde" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:46:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-8fd51eb4-ff37-4b77-abc7-39eadaecffde" acquired by "delete_volume" :: waited 0.032s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:46:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c2c182-3e50-41e9-859f-c73caac41e73]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:46:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde" returned: 0 in 1.210s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:46:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8fd51eb4-ff37-4b77-abc7-39eadaecffde" returned: 0 in 0.254s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:46:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-8fd51eb4-ff37-4b77-abc7-39eadaecffde" released by "delete_volume" :: held 1.647s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Created reservations ['8b20b33e-ee19-4402-b034-d7508533bbba', 'ed766081-b8bd-4b95-b02f-3c1da93eb91d', 'd308638d-7e38-421b-be14-f0188051a741', '1d8032cb-9158-490c-8d3d-bfd50e6d2bd1'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.113s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Deleted volume successfully. Sep 26 17:47:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1dadde76-c493-46d4-815b-03f09cec24f3 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-8fd51eb4-ff37-4b77-abc7-39eadaecffde-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-53e84b2e-9867-4288-b980-15f5994d400b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-53e84b2e-9867-4288-b980-15f5994d400b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "cinder-quobyte-53e84b2e-9867-4288-b980-15f5994d400b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-53e84b2e-9867-4288-b980-15f5994d400b" acquired by "delete_volume" :: waited 0.017s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38bbcda-854b-4118-9eb0-1acb49f488d6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:02 devstack quobyte-client[83627]: System call of process 95538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b" returned: 0 in 0.582s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-53e84b2e-9867-4288-b980-15f5994d400b" returned: 0 in 0.169s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-quobyte-53e84b2e-9867-4288-b980-15f5994d400b" released by "delete_volume" :: held 0.995s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Created reservations ['f9d3e462-2d3a-4e6d-96f5-ded375b1af61', '896c2e28-d031-4601-816d-1bc3a16e8faf', 'e5b58c0a-f359-40c0-ac23-427d594af38e', 'b8f3dd2f-367d-4f9d-9ebe-3690b4fff467'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Deleted volume successfully. Sep 26 17:47:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7de7fb73-edce-42bc-8dc8-e0a9f92a0e78 tempest-AttachVolumeNegativeTest-922204878 None] Lock "cinder-53e84b2e-9867-4288-b980-15f5994d400b-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.216s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:13 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:47:13 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:47:13 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:47:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Flow 'volume_create_manager' (4540522b-393d-40e4-b8d4-269cb4beac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689222ac-f870-448c-9bae-4d2d62a70af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689222ac-f870-448c-9bae-4d2d62a70af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1445238044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36ea67e-0781-4817-a443-44e907349467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a3e0dae71d417a96b999478860025a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:18Z,use_quota=True,user_id='e61fc760cd7948b1b39ac50fe96665d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42be0ea-d8d0-4222-a5f9-d4004ea3517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42be0ea-d8d0-4222-a5f9-d4004ea3517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf08d798-292d-4f25-9cf5-daaff85d357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf08d798-292d-4f25-9cf5-daaff85d357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36ea67e-0781-4817-a443-44e907349467', 'volume_name': 'volume-d36ea67e-0781-4817-a443-44e907349467', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79070b77-e50d-45e6-af7e-ec7fdab7807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79070b77-e50d-45e6-af7e-ec7fdab7807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5a339e-8a14-4d9a-a73c-4dc7db927020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:18 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Volume d36ea67e-0781-4817-a443-44e907349467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36ea67e-0781-4817-a443-44e907349467', 'volume_size': 1} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1445238044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36ea67e-0781-4817-a443-44e907349467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a3e0dae71d417a96b999478860025a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:18Z,use_quota=True,user_id='e61fc760cd7948b1b39ac50fe96665d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Creating volume d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:47:18 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:47:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:18 devstack quobyte-client[83627]: System call of process 95624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:18 devstack quobyte-client[83627]: System call of process 95624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:18 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=52, name=volume-d36ea67e-0781-4817-a443-44e907349467, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 1073741824" returned: 0 in 0.409s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5a339e-8a14-4d9a-a73c-4dc7db927020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36ea67e-0781-4817-a443-44e907349467', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418b34cd-88bb-4c26-acee-464f9f140368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:19 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Volume volume-d36ea67e-0781-4817-a443-44e907349467 (d36ea67e-0781-4817-a443-44e907349467): created successfully Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418b34cd-88bb-4c26-acee-464f9f140368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:19 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Flow 'volume_create_manager' (4540522b-393d-40e4-b8d4-269cb4beac01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:19 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-43959363-127e-4ca6-842d-a63a7f1263b1 req-a070ae1c-8fcf-4196-b4c7-ee1380e53ece tempest-VolumesSnapshotsTestJSON-173190142 None] Created volume successfully. Sep 26 17:47:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Creating offline snapshot 2610d581-3b8a-4745-a40e-7064016bad4a of volume d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f8949-01e1-4f80-b6fd-ddd83044a7ce]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467" returned: 0 in 0.497s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:21 devstack quobyte-client[83627]: System call of process 95631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:21 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=53, name=volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a 1G" returned: 0 in 0.256s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d36ea67e-0781-4817-a443-44e907349467 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:22 devstack quobyte-client[83627]: System call of process 95634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "qemu-img rebase -u -b volume-d36ea67e-0781-4817-a443-44e907349467 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.220s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.119s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.info" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.info" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-88b227fd-1a70-4073-b707-5c71447dd911 req-b544bd12-f617-4367-be7e-9f26ae090624 tempest-VolumesSnapshotsTestJSON-173190142 None] Create snapshot completed successfully Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "cinder-2610d581-3b8a-4745-a40e-7064016bad4a-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-2610d581-3b8a-4745-a40e-7064016bad4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "cinder-quobyte-2610d581-3b8a-4745-a40e-7064016bad4a" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-2610d581-3b8a-4745-a40e-7064016bad4a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Deleting offline snapshot 2610d581-3b8a-4745-a40e-7064016bad4a of volume d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] snapshot_file for this snap is: volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087cfe1-168c-44ce-a8a8-a34a3df0ca1d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:24 devstack quobyte-client[83627]: System call of process 95643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.530s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36ea67e-0781-4817-a443-44e907349467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:47:24 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe4d84-7b0e-4777-a889-0884b40d5d40]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467" returned: 0 in 0.603s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:25 devstack quobyte-client[83627]: System call of process 95649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.271s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467.2610d581-3b8a-4745-a40e-7064016bad4a" returned: 0 in 0.677s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-2610d581-3b8a-4745-a40e-7064016bad4a" released by "_delete_snapshot" :: held 3.146s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" released by "delete_snapshot" :: held 3.235s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:27 devstack cinder-volume[83624]: DEBUG cinder.quota [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Created reservations ['e2d8ac56-07d0-4ff9-9e85-9a8b53b1321e', 'da21e8c0-fbc3-463f-a29e-0448c5ce9cf5', 'f43bcaef-3144-47a8-911c-d5866f8f478a', 'da3ee8ce-e7cf-4597-a1c3-6dc6b80c0efa'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Delete snapshot completed successfully. Sep 26 17:47:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-3baedd3a-6b47-4d3f-a206-e7c22f2bf23e req-36e912e9-cd28-4009-ad01-655942020f33 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-2610d581-3b8a-4745-a40e-7064016bad4a-delete_snapshot" released by "delete_snapshot" :: held 4.056s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "cinder-d36ea67e-0781-4817-a443-44e907349467-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-d36ea67e-0781-4817-a443-44e907349467-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e2f0d-22ec-4e59-9444-8626655e4ed4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:29 devstack quobyte-client[83627]: System call of process 95695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467" returned: 0 in 0.588s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d36ea67e-0781-4817-a443-44e907349467" returned: 0 in 0.723s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-quobyte-d36ea67e-0781-4817-a443-44e907349467" released by "delete_volume" :: held 1.615s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:30 devstack cinder-volume[83624]: DEBUG cinder.quota [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Created reservations ['2f2655b2-864d-4ec5-9c8d-63f22ff57973', 'b2afc3a7-d0ad-415d-8f0a-4f0705b5b1a6', '6b795b74-86d5-41ca-bd96-1113f47e3c9a', '714ce3a4-0080-4e04-91a5-feb64ba87f13'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG cinder.manager [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:31 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Deleted volume successfully. Sep 26 17:47:31 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-5e5aa777-50ce-4a7d-a984-98bbe3046fbb req-fdb250b1-68fc-4941-8504-6feb93763b41 tempest-VolumesSnapshotsTestJSON-173190142 None] Lock "cinder-d36ea67e-0781-4817-a443-44e907349467-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:36 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Flow 'volume_create_manager' (66f7ee52-8ddf-4820-94a3-6e935be18daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e8bb65-f0f2-4eb4-9951-396034357aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e8bb65-f0f2-4eb4-9951-396034357aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-119918600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb373c9b-c71f-48d1-8fb7-1490acfd3ec2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5de518298b214f27ae6f4090dbca8a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:36Z,use_quota=True,user_id='37af37b76ba64bc48adb155d3d9f6e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a90c104-c8e9-45b1-9bbb-513848ea6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a90c104-c8e9-45b1-9bbb-513848ea6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0152e6a0-34f5-4431-b413-63161b2fe8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0152e6a0-34f5-4431-b413-63161b2fe8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb373c9b-c71f-48d1-8fb7-1490acfd3ec2', 'volume_name': 'volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe75327-f75b-4976-b8e0-231e5a7e7fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe75327-f75b-4976-b8e0-231e5a7e7fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f6c2c-ec7c-472e-8d58-0a6df5200d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Volume bb373c9b-c71f-48d1-8fb7-1490acfd3ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2', 'volume_size': 1} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-119918600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb373c9b-c71f-48d1-8fb7-1490acfd3ec2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5de518298b214f27ae6f4090dbca8a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:36Z,use_quota=True,user_id='37af37b76ba64bc48adb155d3d9f6e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Creating volume bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:47:36 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:47:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:37 devstack quobyte-client[83627]: System call of process 95707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:37 devstack quobyte-client[83627]: System call of process 95707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:37 devstack quobyte-client[83627]: System call of process 95707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:37 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=55, name=volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 1073741824" returned: 0 in 0.444s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" returned: 0 in 0.181s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f6c2c-ec7c-472e-8d58-0a6df5200d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652fa76-c6af-465e-b687-384fe8621865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:37 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Volume volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 (bb373c9b-c71f-48d1-8fb7-1490acfd3ec2): created successfully Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652fa76-c6af-465e-b687-384fe8621865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Flow 'volume_create_manager' (66f7ee52-8ddf-4820-94a3-6e935be18daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-33499bb2-8bb1-4a3f-966c-2ad803442fd1 req-1cb7393f-15ca-48bb-a442-5892cb577a9b tempest-VolumesGetTestJSON-649420582 None] Created volume successfully. Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Acquiring lock "cinder-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "cinder-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:39 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Acquiring lock "cinder-quobyte-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "cinder-quobyte-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" acquired by "delete_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[20795e1c-3533-4f79-a449-eb8f27899ba3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" returned: 0 in 0.527s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" returned: 0 in 0.098s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "cinder-quobyte-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2" released by "delete_volume" :: held 0.810s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG cinder.quota [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Created reservations ['cda0c052-6f28-46ed-8476-8e1ab07d9de7', 'bfe05663-faa8-40dd-88a2-82420803692c', 'ec7d3bf5-4d21-4606-bf2f-03432b85d60b', '04844e3f-e4b1-4f61-833f-a1f2af21c115'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:40 devstack cinder-volume[83624]: DEBUG cinder.manager [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:40 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Deleted volume successfully. Sep 26 17:47:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-7bbaf0d7-c1fb-4975-98be-02ccd23b6376 req-7ac05996-9ae2-4e4c-b24a-6b6f3ee39f0d tempest-VolumesGetTestJSON-649420582 None] Lock "cinder-bb373c9b-c71f-48d1-8fb7-1490acfd3ec2-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (2dee3c10-03ed-4cc3-822e-270f3e2c2d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64f9f3e-e926-43df-b1be-10366c6a3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64f9f3e-e926-43df-b1be-10366c6a3d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1482154179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3711786-1dd6-4e75-9144-21166a5287f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:44Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bffe3cf-460e-44d3-bdc6-4134c4341eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bffe3cf-460e-44d3-bdc6-4134c4341eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e96be31-6bdf-4242-a848-dd1d771f6785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e96be31-6bdf-4242-a848-dd1d771f6785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3711786-1dd6-4e75-9144-21166a5287f2', 'volume_name': 'volume-a3711786-1dd6-4e75-9144-21166a5287f2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06cc0a0-4d84-4dbc-8dee-9daf2830bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06cc0a0-4d84-4dbc-8dee-9daf2830bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180ee188-09a3-44d2-a7ce-880d4e0a5e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Volume a3711786-1dd6-4e75-9144-21166a5287f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3711786-1dd6-4e75-9144-21166a5287f2', 'volume_size': 1} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1482154179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3711786-1dd6-4e75-9144-21166a5287f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:44Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Creating volume a3711786-1dd6-4e75-9144-21166a5287f2 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:47:44 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:44 devstack quobyte-client[83627]: System call of process 95718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=56, name=volume-a3711786-1dd6-4e75-9144-21166a5287f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2 1073741824" returned: 0 in 0.315s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2" returned: 0 in 0.083s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] <== create_volume: return (468ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:47:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180ee188-09a3-44d2-a7ce-880d4e0a5e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3711786-1dd6-4e75-9144-21166a5287f2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca69db-73f3-4439-9bc7-56f5eedaa223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Volume volume-a3711786-1dd6-4e75-9144-21166a5287f2 (a3711786-1dd6-4e75-9144-21166a5287f2): created successfully Sep 26 17:47:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca69db-73f3-4439-9bc7-56f5eedaa223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (2dee3c10-03ed-4cc3-822e-270f3e2c2d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ad336c9f-cf5c-4e4e-ae87-9776c1c8c698 tempest-VolumesTestJSON-543489724 None] Created volume successfully. Sep 26 17:47:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (1d339961-0abe-4779-8947-a4708780a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6926471-444b-45c6-a608-57498e2aae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6926471-444b-45c6-a608-57498e2aae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992600899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49227a1a-2121-4140-9aae-3a9d4595c4d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:47Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f57ad-af62-4e1c-9bf9-17c9865d2605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f57ad-af62-4e1c-9bf9-17c9865d2605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feabfbdf-a04c-4b1b-8223-0fa9457814c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feabfbdf-a04c-4b1b-8223-0fa9457814c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49227a1a-2121-4140-9aae-3a9d4595c4d2', 'volume_name': 'volume-49227a1a-2121-4140-9aae-3a9d4595c4d2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19905ec7-9ca7-42ef-94fd-1835beab969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19905ec7-9ca7-42ef-94fd-1835beab969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b659f3-b526-433f-9f27-1435574ce932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:47 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Volume 49227a1a-2121-4140-9aae-3a9d4595c4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49227a1a-2121-4140-9aae-3a9d4595c4d2', 'volume_size': 1} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992600899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49227a1a-2121-4140-9aae-3a9d4595c4d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:47Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Creating volume 49227a1a-2121-4140-9aae-3a9d4595c4d2 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:47:47 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:47:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:47 devstack quobyte-client[83627]: System call of process 95724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:47 devstack quobyte-client[83627]: System call of process 95724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:47 devstack quobyte-client[83627]: System call of process 95724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:48 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=57, name=volume-49227a1a-2121-4140-9aae-3a9d4595c4d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 1073741824" returned: 0 in 0.871s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2" returned: 0 in 0.242s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] <== create_volume: return (1260ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:47:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b659f3-b526-433f-9f27-1435574ce932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49227a1a-2121-4140-9aae-3a9d4595c4d2', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d4b527-c8bc-41a2-b075-fd94edef6d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:49 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Volume volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 (49227a1a-2121-4140-9aae-3a9d4595c4d2): created successfully Sep 26 17:47:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d4b527-c8bc-41a2-b075-fd94edef6d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (1d339961-0abe-4779-8947-a4708780a336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-10bd1221-b105-4c7c-b46a-b6ad2fd156e1 tempest-VolumesTestJSON-543489724 None] Created volume successfully. Sep 26 17:47:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (5cee20bc-f42f-4172-9aed-afb4c88b33d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb48687-40f6-4c6a-aaf6-e03411375d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb48687-40f6-4c6a-aaf6-e03411375d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1098538832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786c8d60-84b9-413b-9ddc-e7a2a7cbd10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:51Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8400859c-cf96-45c6-b14c-0b4867c654fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8400859c-cf96-45c6-b14c-0b4867c654fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd37dc9-2dbd-4329-b8c6-0c92746e7c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd37dc9-2dbd-4329-b8c6-0c92746e7c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786c8d60-84b9-413b-9ddc-e7a2a7cbd10d', 'volume_name': 'volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c2aaad-4784-4b1a-8560-0340d60dabde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c2aaad-4784-4b1a-8560-0340d60dabde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44c7bbf-ce38-42d7-a5ac-ddcefbd61efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:51 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Volume 786c8d60-84b9-413b-9ddc-e7a2a7cbd10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d', 'volume_size': 1} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1098538832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786c8d60-84b9-413b-9ddc-e7a2a7cbd10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3dd0052d848d58a182e814bff67c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:47:51Z,use_quota=True,user_id='094249db143b4e7d9a3a28819c24f821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Creating volume 786c8d60-84b9-413b-9ddc-e7a2a7cbd10d {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:47:51 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:47:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:51 devstack quobyte-client[83627]: System call of process 95753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:51 devstack quobyte-client[83627]: System call of process 95753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:51 devstack quobyte-client[83627]: System call of process 95753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:51 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=58, name=volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d 1073741824" returned: 0 in 0.765s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" returned: 0 in 0.189s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] <== create_volume: return (1133ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44c7bbf-ce38-42d7-a5ac-ddcefbd61efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af96a076-d87d-4d65-8917-71c813e8b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:47:52 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Volume volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d (786c8d60-84b9-413b-9ddc-e7a2a7cbd10d): created successfully Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af96a076-d87d-4d65-8917-71c813e8b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:47:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Flow 'volume_create_manager' (5cee20bc-f42f-4172-9aed-afb4c88b33d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:47:52 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a057f81b-5056-441a-ad11-2241494a4d24 tempest-VolumesTestJSON-543489724 None] Created volume successfully. Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "cinder-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:54 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-quobyte-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[db705bad-d07d-4252-8f0f-eb150c1fc1ab]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:55 devstack quobyte-client[83627]: System call of process 95768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:55 devstack quobyte-client[83627]: System call of process 95768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:47:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" returned: 0 in 0.909s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" returned: 0 in 0.235s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d" released by "delete_volume" :: held 1.550s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Created reservations ['d70f01ff-ed1c-407f-9f93-71f18fa31b11', 'e4eb461f-c117-4b4c-9dfb-1e466ec61998', 'fea42959-591a-4367-9a7f-a4b534bb3757', '16b5535f-9e68-42d0-afe5-944838036478'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.133s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:56 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:47:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Deleted volume successfully. Sep 26 17:47:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8e0596e5-46ef-419d-902b-350b11971a1c tempest-VolumesTestJSON-543489724 None] Lock "cinder-786c8d60-84b9-413b-9ddc-e7a2a7cbd10d-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-49227a1a-2121-4140-9aae-3a9d4595c4d2-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "cinder-49227a1a-2121-4140-9aae-3a9d4595c4d2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-quobyte-49227a1a-2121-4140-9aae-3a9d4595c4d2" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-49227a1a-2121-4140-9aae-3a9d4595c4d2" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22eea63-b7a4-414a-9bf0-6128b8901e42]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:47:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2" returned: 0 in 0.804s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:47:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49227a1a-2121-4140-9aae-3a9d4595c4d2" returned: 0 in 0.275s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:47:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-49227a1a-2121-4140-9aae-3a9d4595c4d2" released by "delete_volume" :: held 1.357s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:47:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Created reservations ['2efcf30d-f2eb-4f74-b564-da97c929b8b3', 'ab4656a7-b7bb-42a3-a613-edfc021d37bd', '5c0a7c37-1934-4a10-a526-de41c023fa57', '785b96ef-23b4-4a47-99c5-24af26b92180'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.271s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:48:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Deleted volume successfully. Sep 26 17:48:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-a3711786-1dd6-4e75-9144-21166a5287f2-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9445be69-3442-4d72-8282-c870cad71d53 tempest-VolumesTestJSON-543489724 None] Lock "cinder-49227a1a-2121-4140-9aae-3a9d4595c4d2-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "cinder-a3711786-1dd6-4e75-9144-21166a5287f2-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:02 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Acquiring lock "cinder-quobyte-a3711786-1dd6-4e75-9144-21166a5287f2" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-a3711786-1dd6-4e75-9144-21166a5287f2" acquired by "delete_volume" :: waited 0.044s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:02 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c8de5-ce10-4ea2-83ba-11c43d7032b3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:04 devstack quobyte-client[83627]: System call of process 95835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:04 devstack quobyte-client[83627]: System call of process 95835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2" returned: 0 in 2.022s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a3711786-1dd6-4e75-9144-21166a5287f2" returned: 0 in 0.325s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "cinder-quobyte-a3711786-1dd6-4e75-9144-21166a5287f2" released by "delete_volume" :: held 3.004s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Created reservations ['bdde78cb-8325-4f5e-8854-0dcb1fbbf698', '9c3dc029-68d1-4c17-95f9-a3d18f5274c6', '63817ef3-f80e-43a7-8c34-39ddf4ff4e20', 'c3036e16-e728-4769-8504-72ea7bcadd0e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.247s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:48:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Deleted volume successfully. Sep 26 17:48:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2c25161-d1b0-47ab-a57e-5726bcaffc7b tempest-VolumesTestJSON-543489724 None] Lock "cinder-a3711786-1dd6-4e75-9144-21166a5287f2-delete_volume" released by "delete_volume" :: held 6.173s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.530s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:48:13 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=57,cinder:SELECT=39,cinder:INSERT=13,cinder:DELETE=5 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:48:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-e62c7ec0-6835-4d7f-95bd-ff99f5a8aa88 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:15 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=35,cinder:UPDATE=57,cinder:DELETE=6,cinder:INSERT=11 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:48:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-e62c7ec0-6835-4d7f-95bd-ff99f5a8aa88 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-e62c7ec0-6835-4d7f-95bd-ff99f5a8aa88 tempest-TestShelveInstance-1707170798 None] Terminate volume connection completed successfully. Sep 26 17:48:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-e62c7ec0-6835-4d7f-95bd-ff99f5a8aa88 tempest-TestShelveInstance-1707170798 None] Deleting attachment 98699f43-6b07-44e4-bb0d-e6ae1a1f813f. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Acquiring lock "cinder-364641ad-1d70-4678-b749-f1b2ce6a1637-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d576f797-84e3-4279-844d-a8274e0e3578 tempest-BackendsCapabilitiesAdminTestsJSON-1783525246 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83624) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "cinder-364641ad-1d70-4678-b749-f1b2ce6a1637-delete_volume" acquired by "delete_volume" :: waited 0.176s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Acquiring lock "cinder-quobyte-364641ad-1d70-4678-b749-f1b2ce6a1637" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "cinder-quobyte-364641ad-1d70-4678-b749-f1b2ce6a1637" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b3305-f570-45da-afda-c34acdf1f75f]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de564b06-5ecd-4b60-b30b-4fc895b03df1 tempest-BackendsCapabilitiesAdminTestsJSON-1783525246 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83624) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 26 17:48:17 devstack quobyte-client[83627]: System call of process 95920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:17 devstack quobyte-client[83627]: System call of process 95920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:17 devstack quobyte-client[83627]: System call of process 95920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 1.448s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:19 devstack quobyte-client[83627]: System call of process 95944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 1 in 1.498s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:48:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-364641ad-1d70-4678-b749-f1b2ce6a1637" returned: 0 in 0.218s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "cinder-quobyte-364641ad-1d70-4678-b749-f1b2ce6a1637" released by "delete_volume" :: held 3.530s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG cinder.quota [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Created reservations ['631bf5db-4089-4fcb-b613-940ca29160c3', '762f45cd-bfc3-4881-acbe-7fd472b04d06', '65c37e66-8972-42a0-9d7d-3b60b9da9986', '40f81ad4-538b-4b23-ad1f-ab6c723893a7'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.297s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:21 devstack cinder-volume[83624]: DEBUG cinder.manager [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:48:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Deleted volume successfully. Sep 26 17:48:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [req-529ed322-3029-4b34-aaee-6538f9ba4694 req-a6a4c460-d000-4eb7-b8bb-71bace01e8d0 tempest-TestShelveInstance-1707170798 None] Lock "cinder-364641ad-1d70-4678-b749-f1b2ce6a1637-delete_volume" released by "delete_volume" :: held 5.480s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f5672d58-af13-4fea-ad83-1b2ca09e4882 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f5672d58-af13-4fea-ad83-1b2ca09e4882 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-1132054640: creating Sep 26 17:48:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f5672d58-af13-4fea-ad83-1b2ca09e4882 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-1132054640: created successfully Sep 26 17:48:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f5672d58-af13-4fea-ad83-1b2ca09e4882 tempest-GroupSnapshotsTest-1215085635 None] Create group completed successfully. Sep 26 17:48:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (17b500f7-7ec1-4633-a6cd-f0ae0075a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861c29e0-e130-4bee-9a81-a47a22d15f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861c29e0-e130-4bee-9a81-a47a22d15f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385055789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=905a6d92-744d-4dd6-b5ac-4347e18336c3,host='devstack@QuobyteHD#QuobyteHD',id=351d6cfd-0336-487a-aa33-62708fd439f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:30Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31114ade-c52d-4a6b-b2d2-09f3d09bb66c),volume_type_id=31114ade-c52d-4a6b-b2d2-09f3d09bb66c)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7428a1ec-c288-4e31-bb47-70b3d4511c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7428a1ec-c288-4e31-bb47-70b3d4511c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a514e83-c91d-45d3-9402-24f364ad5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a514e83-c91d-45d3-9402-24f364ad5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351d6cfd-0336-487a-aa33-62708fd439f7', 'volume_name': 'volume-351d6cfd-0336-487a-aa33-62708fd439f7', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f496667-8928-4d9b-a6a4-959e0efc8e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f496667-8928-4d9b-a6a4-959e0efc8e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f018d049-ea47-4204-becd-3c8eac95dea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Volume 351d6cfd-0336-487a-aa33-62708fd439f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351d6cfd-0336-487a-aa33-62708fd439f7', 'volume_size': 1} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=905a6d92-744d-4dd6-b5ac-4347e18336c3,created_at=2025-09-26T15:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385055789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=905a6d92-744d-4dd6-b5ac-4347e18336c3,host='devstack@QuobyteHD#QuobyteHD',id=351d6cfd-0336-487a-aa33-62708fd439f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:30Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31114ade-c52d-4a6b-b2d2-09f3d09bb66c),volume_type_id=31114ade-c52d-4a6b-b2d2-09f3d09bb66c)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Creating volume 351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:48:30 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:30 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=59, name=volume-351d6cfd-0336-487a-aa33-62708fd439f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 1073741824" returned: 0 in 0.597s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.123s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f018d049-ea47-4204-becd-3c8eac95dea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351d6cfd-0336-487a-aa33-62708fd439f7', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8220be-1455-43ed-8deb-866f91c97e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Volume volume-351d6cfd-0336-487a-aa33-62708fd439f7 (351d6cfd-0336-487a-aa33-62708fd439f7): created successfully Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8220be-1455-43ed-8deb-866f91c97e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (17b500f7-7ec1-4633-a6cd-f0ae0075a940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:31 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-092dde38-2b43-47bf-ad4b-d9143dee37f0 tempest-GroupSnapshotsTest-1215085635 None] Created volume successfully. Sep 26 17:48:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] GroupSnapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: creating. Sep 26 17:48:33 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Group snapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: creating. {{(pid=83624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Creating offline snapshot 33f94132-a869-4775-b2d2-6b361b89bdda of volume 351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[61997ad3-fce4-4d3c-a20f-a727364c8b8a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:34 devstack quobyte-client[83627]: System call of process 95969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.890s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:34 devstack quobyte-client[83627]: System call of process 95972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:34 devstack quobyte-client[83627]: System call of process 95972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:34 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=60, name=volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda 1G" returned: 0 in 0.431s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-351d6cfd-0336-487a-aa33-62708fd439f7 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:35 devstack quobyte-client[83627]: System call of process 95975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img rebase -u -b volume-351d6cfd-0336-487a-aa33-62708fd439f7 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.232s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.info" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.info" returned: 0 in 0.224s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-747c405c-4ead-4fdc-b64e-3e2a4b64025d tempest-GroupSnapshotsTest-1215085635 None] group_snapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: created successfully Sep 26 17:48:39 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda-a992b0d8-f9f0-4776-8cf3-95724e03e64e" by "_create_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda-a992b0d8-f9f0-4776-8cf3-95724e03e64e" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Creating volume a992b0d8-f9f0-4776-8cf3-95724e03e64e from snapshot 33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" by "_copy_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] snapshot: 33f94132-a869-4775-b2d2-6b361b89bdda, volume: a992b0d8-f9f0-4776-8cf3-95724e03e64e, {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a66ad-a580-433a-946e-bddd9c679afc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:40 devstack quobyte-client[83627]: System call of process 96008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.563s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-351d6cfd-0336-487a-aa33-62708fd439f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Creating direct copy from snapshot {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b899d71-ee86-4d5c-a6d0-29cb8d2d11fe]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.591s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:41 devstack cinder-volume[83624]: DEBUG cinder.utils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e not found in is_blk_device check {{(pid=83624) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 26 17:48:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:41 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=62, name=volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e" returned: 0 in 6.611s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:47 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec7a3cd-50fd-462b-a53e-d4a7880c9c1c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.819s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:48 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:48:48 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Converted 1024.00 MB image at 154.21 MB/s Sep 26 17:48:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:48:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" released by "_copy_volume_from_snapshot" :: held 9.400s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (c0c856ce-ed0b-4a87-a171-287817cd9641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37e6a02-4409-4b40-8f6b-22070043e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda-a992b0d8-f9f0-4776-8cf3-95724e03e64e" released by "_create_volume_from_snapshot" :: held 9.773s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.853s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37e6a02-4409-4b40-8f6b-22070043e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495050064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc91566-ce0a-4777-a9e9-1bd0664e0654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:49Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f037ba95-9b8c-4380-97d0-2c5c8c692641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f037ba95-9b8c-4380-97d0-2c5c8c692641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb8d39b-1caf-4b02-afb4-e7449cddf72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb8d39b-1caf-4b02-afb4-e7449cddf72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc91566-ce0a-4777-a9e9-1bd0664e0654', 'volume_name': 'volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494bbaa-308e-4698-be70-cea0d08f25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494bbaa-308e-4698-be70-cea0d08f25c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7a0114-0da3-44b5-bbcf-f590510b0aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:49 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume 5cc91566-ce0a-4777-a9e9-1bd0664e0654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654', 'volume_size': 1} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495050064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc91566-ce0a-4777-a9e9-1bd0664e0654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:49Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume 5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:48:49 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:49 devstack quobyte-client[83627]: System call of process 96033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:49 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=63, name=volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:49 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 1073741824" returned: 0 in 0.559s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654" returned: 0 in 0.330s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7a0114-0da3-44b5-bbcf-f590510b0aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b59102-dd58-43bc-90b0-8c757e733b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 (5cc91566-ce0a-4777-a9e9-1bd0664e0654): created successfully Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b59102-dd58-43bc-90b0-8c757e733b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (c0c856ce-ed0b-4a87-a171-287817cd9641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0b5ae0e7-f4c5-42ab-a175-1bb07531084a tempest-GroupSnapshotsTest-1215085635 None] Create group from source-snapshot-d67871bc-230d-4cc9-8e2a-3df306d1f516 completed successfully. Sep 26 17:48:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1eef015b-54d4-4fc2-af6a-89aa1f6d93f7 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:48:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" acquired by "delete_volume" :: waited 0.063s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73eeee9-8bc7-4b55-a523-c8444f645b3b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating offline snapshot da107c85-810a-4397-b36f-e6e2b35df7bf of volume 5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99e1b6-562d-4704-8ef4-3cab6dfd823d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:51 devstack quobyte-client[83627]: System call of process 96037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:51 devstack quobyte-client[83627]: System call of process 96037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e" returned: 0 in 0.590s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a992b0d8-f9f0-4776-8cf3-95724e03e64e" returned: 0 in 0.131s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-a992b0d8-f9f0-4776-8cf3-95724e03e64e" released by "delete_volume" :: held 0.915s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654" returned: 0 in 0.646s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=64, name=volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf 1G" returned: 0 in 0.335s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:52 devstack quobyte-client[83627]: System call of process 96047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img rebase -u -b volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.264s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:48:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.183s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['7da20dab-f16b-461c-9499-7ead0b6b148f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.282s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.info" returned: 0 in 0.224s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:48:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:53 devstack cinder-volume[83624]: WARNING cinder.quota [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1044335080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1044335080, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:48:53 devstack cinder-volume[83624]: WARNING cinder.quota [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1044335080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1044335080, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.info" returned: 0 in 0.287s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['7fb8ea29-ab91-4113-9354-d2b1e729bf74', 'dfde5807-ddf5-44c8-961f-57298b6a0e24', '2fe2bc8d-8802-4c12-a841-21a0f37838a4', '479f7772-2a8e-4c15-aa3a-b2d6c5dfa95d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:48:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bee56221-1987-4b73-b43a-290c908b3b4f tempest-CreateVolumesFromSnapshotTest-919230842 None] Create snapshot completed successfully Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:54 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:48:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fd96a53e-315c-439e-a76e-b5b6cad36bfe tempest-GroupSnapshotsTest-1215085635 None] Delete group completed successfully. Sep 26 17:48:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: deleting Sep 26 17:48:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: deleting {{(pid=83624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 26 17:48:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (7a5f0773-8000-4eb1-b11c-53783b336725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7f17ee-9574-4c58-b075-9f63df1a2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7f17ee-9574-4c58-b075-9f63df1a2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998889819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7afaae-ca09-416a-ae93-78ac78d62b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:55Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bff1462-d99e-4f2f-aa6d-fbda612e7fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bff1462-d99e-4f2f-aa6d-fbda612e7fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dce80c-c5ac-4993-993a-d197eeba7ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dce80c-c5ac-4993-993a-d197eeba7ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7afaae-ca09-416a-ae93-78ac78d62b34', 'volume_name': 'volume-8c7afaae-ca09-416a-ae93-78ac78d62b34', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419bd00c-4d79-443d-a3d5-7197bf6a935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419bd00c-4d79-443d-a3d5-7197bf6a935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b2fcf-3f7e-4487-898e-a4e69c2f0d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:55 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume 8c7afaae-ca09-416a-ae93-78ac78d62b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7afaae-ca09-416a-ae93-78ac78d62b34', 'volume_size': 1} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998889819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7afaae-ca09-416a-ae93-78ac78d62b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:55Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume 8c7afaae-ca09-416a-ae93-78ac78d62b34 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:48:55 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:55 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=66, name=volume-8c7afaae-ca09-416a-ae93-78ac78d62b34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" acquired by "delete_snapshot" :: waited 0.572s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:48:56 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (50308173-d435-4ba3-a7a4-2a74289af100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d339de40-c452-4525-9fe3-3210610cc4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 1073741824" returned: 0 in 0.888s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d339de40-c452-4525-9fe3-3210610cc4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540847602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:55Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d9362d-59a0-45c5-9e3a-8aafb729c384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d9362d-59a0-45c5-9e3a-8aafb729c384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361ea713-7d2b-4575-81be-ee38d296f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361ea713-7d2b-4575-81be-ee38d296f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c', 'volume_name': 'volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef02ef48-dbfb-42f9-b4bf-d9244cb976da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef02ef48-dbfb-42f9-b4bf-d9244cb976da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d4124a-d16a-41e6-afab-64bfafdb4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:56 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c', 'volume_size': 1} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda" acquired by "_delete_snapshot" :: waited 1.340s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Deleting offline snapshot 33f94132-a869-4775-b2d2-6b361b89bdda of volume 351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] snapshot_file for this snap is: volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:48:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (a23766e3-5049-42ee-b921-f1e1a1c20766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795a68a2-eb3e-4206-96b5-6f1906677e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a34c11-7469-4e2a-834d-165248a0726a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (4c928a4b-3ed6-4230-a208-25d890fbddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769bbe40-651f-4391-b87b-2d3802ff4663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34" returned: 0 in 1.762s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769bbe40-651f-4391-b87b-2d3802ff4663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173042184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49155f4-dd37-4c6c-b460-95ed70415eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:56Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ec14b4-d6ee-4d79-ad60-0f8768d6bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ec14b4-d6ee-4d79-ad60-0f8768d6bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:58 devstack quobyte-client[83627]: System call of process 96065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:58 devstack quobyte-client[83627]: System call of process 96065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:58 devstack quobyte-client[83627]: System call of process 96065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:58 devstack quobyte-client[83627]: System call of process 96065 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b258f0c-01b0-4560-9a81-1cdd74680a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b258f0c-01b0-4560-9a81-1cdd74680a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49155f4-dd37-4c6c-b460-95ed70415eba', 'volume_name': 'volume-f49155f4-dd37-4c6c-b460-95ed70415eba', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74fd6e6-84c4-4665-91ac-675c4c6bdbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74fd6e6-84c4-4665-91ac-675c4c6bdbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206fec69-1742-49b2-8c3b-9c2fe7729e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:58 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume f49155f4-dd37-4c6c-b460-95ed70415eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49155f4-dd37-4c6c-b460-95ed70415eba', 'volume_size': 1} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (2998ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540847602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:55Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:48:58 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:48:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:58 devstack quobyte-client[83627]: System call of process 96071 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:48:58 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=67, name=volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795a68a2-eb3e-4206-96b5-6f1906677e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926367447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08465d38-1ab4-46b5-b1da-179fd369a94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:56Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aef064-d3c5-416a-8b4f-0a2047eca60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aef064-d3c5-416a-8b4f-0a2047eca60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667452b5-ab4b-40d1-93c9-8595a04dd6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667452b5-ab4b-40d1-93c9-8595a04dd6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08465d38-1ab4-46b5-b1da-179fd369a94c', 'volume_name': 'volume-08465d38-1ab4-46b5-b1da-179fd369a94c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9255b652-4416-4e4f-a6ac-07bbbbad6ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9255b652-4416-4e4f-a6ac-07bbbbad6ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8404475-8398-4aa4-8f20-f5e3a0228eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume 08465d38-1ab4-46b5-b1da-179fd369a94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08465d38-1ab4-46b5-b1da-179fd369a94c', 'volume_size': 1} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:59 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (76d11d09-e270-4608-86bc-c750d7e057a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69574602-5b40-47c2-a4c7-33ae2c972b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b2fcf-3f7e-4487-898e-a4e69c2f0d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7afaae-ca09-416a-ae93-78ac78d62b34', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff89d79-6d48-43aa-9cb9-62e71740bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 (8c7afaae-ca09-416a-ae93-78ac78d62b34): created successfully Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff89d79-6d48-43aa-9cb9-62e71740bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (7a5f0773-8000-4eb1-b11c-53783b336725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 2.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-351d6cfd-0336-487a-aa33-62708fd439f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69574602-5b40-47c2-a4c7-33ae2c972b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014050979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e5b895-08bc-472b-8398-4a8fc3ad0d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:57Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd1aab1-a7cf-4cd8-bc21-a056f8379477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd1aab1-a7cf-4cd8-bc21-a056f8379477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4787dc-b03d-412c-9b69-4ead634e5d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4787dc-b03d-412c-9b69-4ead634e5d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e5b895-08bc-472b-8398-4a8fc3ad0d2a', 'volume_name': 'volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f81a10-decd-4106-b8f8-db1281d22585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f81a10-decd-4106-b8f8-db1281d22585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594c5f2-3f43-4605-b523-b6f1038fd429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:48:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume 35e5b895-08bc-472b-8398-4a8fc3ad0d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a', 'volume_size': 1} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d8e2c2-8325-4700-b798-d02a626fea12]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:48:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:48:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-94e74ae9-6361-4329-939d-4f2d0cb4a100 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c 1073741824" returned: 0 in 1.535s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" returned: 0 in 0.280s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (1919ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:00 devstack quobyte-client[83627]: System call of process 96081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:00 devstack quobyte-client[83627]: System call of process 96081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173042184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49155f4-dd37-4c6c-b460-95ed70415eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:56Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume f49155f4-dd37-4c6c-b460-95ed70415eba {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:00 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:00 devstack quobyte-client[83627]: System call of process 96086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:00 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=68, name=volume-f49155f4-dd37-4c6c-b460-95ed70415eba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d4124a-d16a-41e6-afab-64bfafdb4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b60443-1c81-4597-b6ee-b9764b7fd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 1.450s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:01 devstack quobyte-client[83627]: System call of process 96089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba 1073741824" returned: 0 in 0.902s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:01 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c (fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c): created successfully Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b60443-1c81-4597-b6ee-b9764b7fd77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (50308173-d435-4ba3-a7a4-2a74289af100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.769s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba" returned: 0 in 0.618s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ef24b877-7312-4eb3-b0c9-33d853437fca tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (1800ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.272s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926367447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08465d38-1ab4-46b5-b1da-179fd369a94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:56Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume 08465d38-1ab4-46b5-b1da-179fd369a94c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:02 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:02 devstack quobyte-client[83627]: System call of process 96097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:02 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=69, name=volume-08465d38-1ab4-46b5-b1da-179fd369a94c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7.33f94132-a869-4775-b2d2-6b361b89bdda" returned: 0 in 0.739s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206fec69-1742-49b2-8c3b-9c2fe7729e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49155f4-dd37-4c6c-b460-95ed70415eba', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89bf9ae-35b4-45af-b6b8-61781d001ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33f94132-a869-4775-b2d2-6b361b89bdda" released by "_delete_snapshot" :: held 5.852s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:03 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-f49155f4-dd37-4c6c-b460-95ed70415eba (f49155f4-dd37-4c6c-b460-95ed70415eba): created successfully Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89bf9ae-35b4-45af-b6b8-61781d001ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (4c928a4b-3ed6-4230-a208-25d890fbddb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c 1073741824" returned: 0 in 0.588s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" released by "delete_snapshot" :: held 7.294s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3366aea1-0af2-40af-b07c-4705df6636f6 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c" returned: 0 in 0.271s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.735s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014050979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e5b895-08bc-472b-8398-4a8fc3ad0d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb9f197520748129a991ba1aba5ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:48:57Z,use_quota=True,user_id='2d9d8f3a85d54ade93235ac2df68289d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Creating volume 35e5b895-08bc-472b-8398-4a8fc3ad0d2a {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:03 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:03 devstack quobyte-client[83627]: System call of process 96104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:03 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=70, name=volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8404475-8398-4aa4-8f20-f5e3a0228eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08465d38-1ab4-46b5-b1da-179fd369a94c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9545b765-3210-448d-bcb8-0fe9bcaea6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a 1073741824" returned: 0 in 0.549s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:04 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-08465d38-1ab4-46b5-b1da-179fd369a94c (08465d38-1ab4-46b5-b1da-179fd369a94c): created successfully Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9545b765-3210-448d-bcb8-0fe9bcaea6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (a23766e3-5049-42ee-b921-f1e1a1c20766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" returned: 0 in 0.449s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] <== create_volume: return (1051ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6c4fb21a-e162-4805-8c4d-43e2f8404b75 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594c5f2-3f43-4605-b523-b6f1038fd429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ce6be7-cd70-4a05-83dc-8063bdb16918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:04 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a (35e5b895-08bc-472b-8398-4a8fc3ad0d2a): created successfully Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ce6be7-cd70-4a05-83dc-8063bdb16918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Flow 'volume_create_manager' (76d11d09-e270-4608-86bc-c750d7e057a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:04 devstack cinder-volume[83624]: WARNING cinder.quota [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1044335080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1044335080, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:49:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2bf1562b-90ac-49e8-99d7-5fa2fc700699 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created volume successfully. Sep 26 17:49:04 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['73ed980e-9d70-42b8-9c01-733c1cb5fbca', '6812624c-c160-4181-a342-6b7a1168cc9c', 'aec0a18c-de7d-4ae0-bae3-a14b5c459939', '2dc080c5-7bfe-4067-9776-5aa75ff6e1ef'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c6ac014a-1737-48d2-80a2-522d0c38f8d9 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot d67871bc-230d-4cc9-8e2a-3df306d1f516: deleted successfully Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-35e5b895-08bc-472b-8398-4a8fc3ad0d2a-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-35e5b895-08bc-472b-8398-4a8fc3ad0d2a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[56358c82-43fd-4298-9df3-8e27f3e1a91d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" returned: 0 in 0.477s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" returned: 0 in 0.514s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-35e5b895-08bc-472b-8398-4a8fc3ad0d2a" released by "delete_volume" :: held 1.144s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" acquired by "delete_volume" :: waited 0.086s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ad1fa-22ea-4f4c-96ab-bc919081bd50]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['2a50ff12-ce95-41dc-a2e9-c27eee5f2343', '4817e71d-529d-460a-9820-4f272554d621', '669b0cbe-5ffc-4c3c-b5ac-d0bea9e01369', '9067c12c-f756-4e64-b66f-e6ff0677d4e4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.655s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-351d6cfd-0336-487a-aa33-62708fd439f7" returned: 0 in 0.324s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-f49155f4-dd37-4c6c-b460-95ed70415eba-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-351d6cfd-0336-487a-aa33-62708fd439f7" released by "delete_volume" :: held 1.304s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.467s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-f49155f4-dd37-4c6c-b460-95ed70415eba-delete_volume" acquired by "delete_volume" :: waited 0.316s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44afd16f-7cfc-42f1-a249-430688f4c0b2 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-35e5b895-08bc-472b-8398-4a8fc3ad0d2a-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-f49155f4-dd37-4c6c-b460-95ed70415eba" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-f49155f4-dd37-4c6c-b460-95ed70415eba" acquired by "delete_volume" :: waited 0.029s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['654690bf-0f9e-4ace-a1f5-97d6ac42d2d2'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[703c2b79-3818-4baf-9c9b-d6dceedae615]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:08 devstack cinder-volume[83624]: WARNING cinder.db.sqlalchemy.api [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1044335080'] Sep 26 17:49:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['e5dc15bc-96c6-4bfc-b954-50559cfdeb34', '6d3ccedc-b559-4d9e-af7a-2171064b4283', 'a643ab2f-1539-488e-a28d-4b053a8fc776', '8edfdc33-93f3-4f51-a2cb-72382f89ba3e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:09 devstack quobyte-client[83627]: System call of process 96126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:09 devstack quobyte-client[83627]: System call of process 96126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:09 devstack quobyte-client[83627]: System call of process 96126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba" returned: 0 in 0.882s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.177s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:09 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a9f1dd82-60b0-4d8c-bf29-b6cbe3b709a2 tempest-GroupSnapshotsTest-1215085635 None] Delete group completed successfully. Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f49155f4-dd37-4c6c-b460-95ed70415eba" returned: 0 in 0.223s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-f49155f4-dd37-4c6c-b460-95ed70415eba" released by "delete_volume" :: held 1.438s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.653s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['d3321099-3536-41c2-a578-db5ae5dbcb88', 'a6c6a680-dc6b-4880-badb-16c1c3a27d3c', '8c85d9c0-6e6a-49fd-bbdc-5f110b84ea83', '9f087ac1-c50a-41cf-a471-82cc563727c0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9e8ac9b5-81a5-4443-ac70-b3cf273050e8 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9e8ac9b5-81a5-4443-ac70-b3cf273050e8 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-582735399: creating Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.388s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9e8ac9b5-81a5-4443-ac70-b3cf273050e8 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-582735399: created successfully Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-44e3bd89-0d5f-4fdb-9fc8-f06b5cac3850 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-f49155f4-dd37-4c6c-b460-95ed70415eba-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9e8ac9b5-81a5-4443-ac70-b3cf273050e8 tempest-GroupSnapshotsTest-1215085635 None] Create group completed successfully. Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-08465d38-1ab4-46b5-b1da-179fd369a94c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-08465d38-1ab4-46b5-b1da-179fd369a94c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-08465d38-1ab4-46b5-b1da-179fd369a94c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-08465d38-1ab4-46b5-b1da-179fd369a94c" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe744e-324b-44ea-931e-6d8bef00ccbb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c" returned: 0 in 0.545s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-08465d38-1ab4-46b5-b1da-179fd369a94c" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-08465d38-1ab4-46b5-b1da-179fd369a94c" released by "delete_volume" :: held 0.973s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:12 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (bd66a606-ea55-43c8-8d74-43d148bd5e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0163e6ae-9f0f-4f87-9321-9bbf0d63ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0163e6ae-9f0f-4f87-9321-9bbf0d63ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712791454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5800a06-72be-4461-b403-6feb3927b019,host='devstack@QuobyteHD#QuobyteHD',id=ec71e99b-0a7b-40e9-bdc3-78053892a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:12Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef9f00-f3d0-444b-8dcb-14d88fde4906),volume_type_id=39ef9f00-f3d0-444b-8dcb-14d88fde4906)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92913dd-1f57-4040-8851-24cdc5d3c0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92913dd-1f57-4040-8851-24cdc5d3c0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53990d92-5401-4244-95a7-4c9dc43a1fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53990d92-5401-4244-95a7-4c9dc43a1fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec71e99b-0a7b-40e9-bdc3-78053892a324', 'volume_name': 'volume-ec71e99b-0a7b-40e9-bdc3-78053892a324', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a4699-6228-4804-9db6-f06ccf8000b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a4699-6228-4804-9db6-f06ccf8000b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f164b3-ca13-452a-ac02-5f2a8ae00ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:12 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Volume ec71e99b-0a7b-40e9-bdc3-78053892a324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec71e99b-0a7b-40e9-bdc3-78053892a324', 'volume_size': 1} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5800a06-72be-4461-b403-6feb3927b019,created_at=2025-09-26T15:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712791454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5800a06-72be-4461-b403-6feb3927b019,host='devstack@QuobyteHD#QuobyteHD',id=ec71e99b-0a7b-40e9-bdc3-78053892a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:12Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef9f00-f3d0-444b-8dcb-14d88fde4906),volume_type_id=39ef9f00-f3d0-444b-8dcb-14d88fde4906)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Creating volume ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:12 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['95f0b794-be58-4a17-b0a1-738fd8a4b067', '2b19ae89-3bd3-4152-8c1b-b37085e316f9', '34de535d-6fbd-4ca7-b4c8-a37f35851c07', 'a8c28c6b-99bb-4a2e-b725-ccf7d9c62b1e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:13 devstack quobyte-client[83627]: System call of process 96138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:13 devstack quobyte-client[83627]: System call of process 96138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:13 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=71, name=volume-ec71e99b-0a7b-40e9-bdc3-78053892a324, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 1073741824" returned: 0 in 0.472s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324" returned: 0 in 0.462s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] <== create_volume: return (972ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f164b3-ca13-452a-ac02-5f2a8ae00ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec71e99b-0a7b-40e9-bdc3-78053892a324', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400784f-ee14-4844-ba1a-1e5ccaaf4889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c-delete_volume" acquired by "delete_volume" :: waited 0.250s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:14 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Volume volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 (ec71e99b-0a7b-40e9-bdc3-78053892a324): created successfully Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400784f-ee14-4844-ba1a-1e5ccaaf4889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (bd66a606-ea55-43c8-8d74-43d148bd5e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:14 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0349c96f-a221-4cec-b27f-672de86b10dc tempest-GroupSnapshotsTest-1215085635 None] Created volume successfully. Sep 26 17:49:14 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.483s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:14 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" acquired by "delete_volume" :: waited 0.115s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d9595318-b47d-46d7-9e9f-20f44a7c3b0c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-08465d38-1ab4-46b5-b1da-179fd369a94c-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9b0e6-eea4-4f0d-8188-b93a8b0367c7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:15 devstack quobyte-client[83627]: System call of process 96143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:15 devstack quobyte-client[83627]: System call of process 96143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:15 devstack quobyte-client[83627]: System call of process 96143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:15 devstack quobyte-client[83627]: System call of process 96143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" returned: 0 in 0.914s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:15 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (08ef9e03-ab72-4d4f-bd57-3672c04d9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:15 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a48b434-5bac-445c-868d-a00df40815fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a48b434-5bac-445c-868d-a00df40815fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1195661080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5800a06-72be-4461-b403-6feb3927b019,host='devstack@QuobyteHD#QuobyteHD',id=d27e05ed-9416-4a66-a9eb-4c81d1508878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:15Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef9f00-f3d0-444b-8dcb-14d88fde4906),volume_type_id=39ef9f00-f3d0-444b-8dcb-14d88fde4906)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7172ef07-75e9-4cb2-a14b-a0c504ab34da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7172ef07-75e9-4cb2-a14b-a0c504ab34da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802f444-05dc-45cd-8f27-bc986f50eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802f444-05dc-45cd-8f27-bc986f50eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27e05ed-9416-4a66-a9eb-4c81d1508878', 'volume_name': 'volume-d27e05ed-9416-4a66-a9eb-4c81d1508878', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418b568-c00a-466e-afe6-7847c92ae9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418b568-c00a-466e-afe6-7847c92ae9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9211ccd2-0765-4877-9f6c-68db41b0d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:16 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Volume d27e05ed-9416-4a66-a9eb-4c81d1508878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27e05ed-9416-4a66-a9eb-4c81d1508878', 'volume_size': 1} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5800a06-72be-4461-b403-6feb3927b019,created_at=2025-09-26T15:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1195661080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5800a06-72be-4461-b403-6feb3927b019,host='devstack@QuobyteHD#QuobyteHD',id=d27e05ed-9416-4a66-a9eb-4c81d1508878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:15Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ef9f00-f3d0-444b-8dcb-14d88fde4906),volume_type_id=39ef9f00-f3d0-444b-8dcb-14d88fde4906)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Creating volume d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:16 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" returned: 0 in 0.623s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:16 devstack quobyte-client[83627]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:16 devstack quobyte-client[83627]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:16 devstack quobyte-client[83627]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=72, name=volume-d27e05ed-9416-4a66-a9eb-4c81d1508878, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c" released by "delete_volume" :: held 1.721s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=64,cinder:INSERT=17,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 1073741824" returned: 0 in 0.513s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878" returned: 0 in 0.263s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:16 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['b93bcfde-38bc-4662-a24b-a957d385bfbf', 'f1d43b08-c17f-46c2-81fb-35e7eb7a39d5', 'f0c1dfc9-54a0-4396-b786-fed4e2771091', '24e55e38-a640-4604-a3bd-44662844c981'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] <== create_volume: return (893ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9211ccd2-0765-4877-9f6c-68db41b0d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27e05ed-9416-4a66-a9eb-4c81d1508878', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c1a65b-604a-4dca-9283-7b03024ab909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:17 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Volume volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 (d27e05ed-9416-4a66-a9eb-4c81d1508878): created successfully Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c1a65b-604a-4dca-9283-7b03024ab909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (08ef9e03-ab72-4d4f-bd57-3672c04d9c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c012ede7-a08d-4746-be73-b840a20242a6 tempest-GroupSnapshotsTest-1215085635 None] Created volume successfully. Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.131s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2674e13a-7804-4a55-bfc8-9f974f7f84cf tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-fcf05bfc-74a6-4f4b-b5fe-514d0346bd5c-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-711a11ee-e39e-453a-8001-9d54d64d8979 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-711a11ee-e39e-453a-8001-9d54d64d8979 tempest-GroupSnapshotsTest-1215085635 None] Update group completed successfully. Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-8c7afaae-ca09-416a-ae93-78ac78d62b34-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-8c7afaae-ca09-416a-ae93-78ac78d62b34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-8c7afaae-ca09-416a-ae93-78ac78d62b34" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-8c7afaae-ca09-416a-ae93-78ac78d62b34" acquired by "delete_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535d00f-21ba-46a8-9ca3-5c678cf7c73f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34" returned: 0 in 0.437s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8c7afaae-ca09-416a-ae93-78ac78d62b34" returned: 0 in 0.524s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-8c7afaae-ca09-416a-ae93-78ac78d62b34" released by "delete_volume" :: held 1.239s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:19 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d3deb1da-2f33-4356-899b-a28ad649fd18 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:19 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d3deb1da-2f33-4356-899b-a28ad649fd18 tempest-GroupSnapshotsTest-1215085635 None] Update group completed successfully. Sep 26 17:49:19 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['55f9c74c-2cf7-4037-96e1-caa15077ed8a', 'eddaff72-2a89-428d-a18a-484cb59de058', '8904e129-afc9-4003-859a-165b497bab2a', 'f27a5af3-131b-4195-9790-a0c3cdef4bef'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.320s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:20 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-da107c85-810a-4397-b36f-e6e2b35df7bf-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4e7f939c-3346-4a51-a425-df7754ba1634 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-da107c85-810a-4397-b36f-e6e2b35df7bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.125s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-da107c85-810a-4397-b36f-e6e2b35df7bf" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-da107c85-810a-4397-b36f-e6e2b35df7bf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleting offline snapshot da107c85-810a-4397-b36f-e6e2b35df7bf of volume 5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] snapshot_file for this snap is: volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-444c348a-7ac5-4cd1-b3d5-9090dfdba22e tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-8c7afaae-ca09-416a-ae93-78ac78d62b34-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d223a0-6a32-414e-a354-d02aaee23ab1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4e7f939c-3346-4a51-a425-df7754ba1634 tempest-GroupSnapshotsTest-1215085635 None] Update group completed successfully. Sep 26 17:49:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-5f3d681e-85a9-4fbc-84b2-b98647831162 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:21 devstack quobyte-client[83627]: System call of process 96192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:21 devstack quobyte-client[83627]: System call of process 96192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.727s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:49:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[455786b6-1f3e-4dbe-b856-81f735e8b33f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-5f3d681e-85a9-4fbc-84b2-b98647831162 tempest-GroupSnapshotsTest-1215085635 None] Update group completed successfully. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654" returned: 0 in 0.787s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:22 devstack quobyte-client[83627]: System call of process 96200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.330s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654.da107c85-810a-4397-b36f-e6e2b35df7bf" returned: 0 in 0.419s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (bf0986c9-09a1-42f8-b7c5-ec9174f37590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bac64bd-50e9-4ea8-b971-dfc01f107efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-da107c85-810a-4397-b36f-e6e2b35df7bf" released by "_delete_snapshot" :: held 2.797s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bac64bd-50e9-4ea8-b971-dfc01f107efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-191947275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb6b471-9d7a-46e1-b77d-beabbb5a2097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:23Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9efd42-1b4f-4d01-a343-4a07fdb9471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9efd42-1b4f-4d01-a343-4a07fdb9471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394218b8-1304-420c-8501-39d7855fe8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394218b8-1304-420c-8501-39d7855fe8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb6b471-9d7a-46e1-b77d-beabbb5a2097', 'volume_name': 'volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f947ab-7d78-45a0-8884-6b2db46ddf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f947ab-7d78-45a0-8884-6b2db46ddf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccfc591-1773-4b94-9a85-23ae970b0481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:24 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Volume bdb6b471-9d7a-46e1-b77d-beabbb5a2097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097', 'volume_size': 1} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-191947275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb6b471-9d7a-46e1-b77d-beabbb5a2097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:23Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Creating volume bdb6b471-9d7a-46e1-b77d-beabbb5a2097 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:24 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" released by "delete_snapshot" :: held 3.000s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:24 devstack quobyte-client[83627]: System call of process 96204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:24 devstack quobyte-client[83627]: System call of process 96204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:24 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=73, name=volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:24 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] GroupSnapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: creating. Sep 26 17:49:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Group snapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: creating. {{(pid=83624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 1073741824" returned: 0 in 0.451s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" returned: 0 in 0.296s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] <== create_volume: return (771ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.081s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccfc591-1773-4b94-9a85-23ae970b0481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1ba539-0119-441f-8d71-54d84a5ed795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Creating offline snapshot 33850ef5-e4e3-4b49-993a-e025ec113591 of volume d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072a753-e721-4208-a5d2-b08a2df24589]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:25 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Volume volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 (bdb6b471-9d7a-46e1-b77d-beabbb5a2097): created successfully Sep 26 17:49:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1ba539-0119-441f-8d71-54d84a5ed795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (bf0986c9-09a1-42f8-b7c5-ec9174f37590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:25 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['253e98fe-b38f-40da-8d89-10a9d89244cc', '31b16aee-aa67-444d-9cd0-06006fdbcb22', 'f8688dea-0aa2-4010-a71a-966760449ddf', 'f2dce7ea-6fc2-4a61-bfbf-39137d5e9148'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:25 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bdf8041b-883c-48c3-9245-b88e6c1dcc87 tempest-AttachVolumeTestJSON-361234456 None] Created volume successfully. Sep 26 17:49:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878" returned: 0 in 0.528s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:25 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=74, name=volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 1G" returned: 0 in 0.517s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img rebase -u -b volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.211s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:26 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Delete snapshot completed successfully. Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.223s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-254b8c45-2733-48b3-93bc-f782c929b52c tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-da107c85-810a-4397-b36f-e6e2b35df7bf-delete_snapshot" released by "delete_snapshot" :: held 5.553s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-5cc91566-ce0a-4777-a9e9-1bd0664e0654-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.316s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-5cc91566-ce0a-4777-a9e9-1bd0664e0654-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.info" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.info" returned: 0 in 0.313s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Creating offline snapshot 8cd9a199-660b-4e9b-b2c0-90a08ffaa182 of volume ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6af3f-d003-4e12-bb97-399830fa7ba9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" acquired by "delete_volume" :: waited 0.239s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[29771d5b-b3b9-430a-ac3f-ff1670b9db35]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324" returned: 0 in 0.590s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:28 devstack quobyte-client[83627]: System call of process 96226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:28 devstack quobyte-client[83627]: System call of process 96226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:28 devstack quobyte-client[83627]: System call of process 96222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:28 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=76, name=volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654" returned: 0 in 0.616s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 1G" returned: 0 in 0.348s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5cc91566-ce0a-4777-a9e9-1bd0664e0654" returned: 0 in 0.211s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:28 devstack quobyte-client[83627]: System call of process 96232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:28 devstack quobyte-client[83627]: System call of process 96232 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-quobyte-5cc91566-ce0a-4777-a9e9-1bd0664e0654" released by "delete_volume" :: held 1.165s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img rebase -u -b volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.421s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.425s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:49:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.513s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Created reservations ['f619d11a-0bea-4855-8986-1a4fb986c8a0', '869d2db6-9776-40aa-a1a7-0fa8cfea5701', '8932535e-71dc-4827-afee-ce14d10a2af3', '7e7761d7-a126-4630-a977-44da7f2ebd0c'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.info" returned: 0 in 0.360s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.info" returned: 0 in 0.276s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.227s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25a0db-63ed-4466-8eb2-cff28a394654]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:31 devstack quobyte-client[83627]: System call of process 96247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:31 devstack quobyte-client[83627]: System call of process 96247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" returned: 0 in 1.077s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.200s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.621s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Deleted volume successfully. Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6b495745-9424-4da6-9bd2-99de77b58728 tempest-CreateVolumesFromSnapshotTest-919230842 None] Lock "cinder-5cc91566-ce0a-4777-a9e9-1bd0664e0654-delete_volume" released by "delete_volume" :: held 5.406s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37f8162a-a173-4a71-b712-72734a9dad46', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:49:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-58250720-69ce-4e42-a411-5f38815c513e tempest-GroupSnapshotsTest-1215085635 None] group_snapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: created successfully Sep 26 17:49:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-ff5930df-c75d-4b08-a46e-a8f5e57388b8 req-000c6d1b-fcf2-4212-ba70-211eb1bec44c tempest-AttachVolumeTestJSON-361234456 None] attachment_update completed successfully. Sep 26 17:49:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: deleting Sep 26 17:49:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: deleting {{(pid=83624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-33850ef5-e4e3-4b49-993a-e025ec113591" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33850ef5-e4e3-4b49-993a-e025ec113591" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Deleting offline snapshot 33850ef5-e4e3-4b49-993a-e025ec113591 of volume d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] snapshot_file for this snap is: volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eec5e0-eab0-4d68-902d-23cdbd1cccdf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:33 devstack quobyte-client[83627]: System call of process 96253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:33 devstack quobyte-client[83627]: System call of process 96253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.591s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d27e05ed-9416-4a66-a9eb-4c81d1508878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2977c5-bd36-4a43-95f2-472f5440e3ac]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:34 devstack quobyte-client[83627]: System call of process 96322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878" returned: 0 in 0.505s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:34 devstack quobyte-client[83627]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:34 devstack quobyte-client[83627]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:34 devstack quobyte-client[83627]: System call of process 96550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.393s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878.33850ef5-e4e3-4b49-993a-e025ec113591" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-33850ef5-e4e3-4b49-993a-e025ec113591" released by "_delete_snapshot" :: held 2.175s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" released by "delete_snapshot" :: held 2.196s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-8cd9a199-660b-4e9b-b2c0-90a08ffaa182" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-8cd9a199-660b-4e9b-b2c0-90a08ffaa182" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Deleting offline snapshot 8cd9a199-660b-4e9b-b2c0-90a08ffaa182 of volume ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] snapshot_file for this snap is: volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c961f54-d1e6-47d2-a63b-789792ddf6ac]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:36 devstack quobyte-client[83627]: System call of process 96648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.622s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec71e99b-0a7b-40e9-bdc3-78053892a324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:49:36 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (66241abe-63fa-43f2-b1b7-2d444be7e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e849ef42-4a25-46f1-a668-d503fdb30680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88564a-a90d-4d05-a2af-8e7e102f7f01]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e849ef42-4a25-46f1-a668-d503fdb30680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1082605321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66240825-9bf4-4c85-9dcd-05936ea971ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:36Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b55ea9-2870-4ba0-9aab-ef778aedd9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b55ea9-2870-4ba0-9aab-ef778aedd9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3fbf99-74d0-46c4-be91-0aaec1573520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3fbf99-74d0-46c4-be91-0aaec1573520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66240825-9bf4-4c85-9dcd-05936ea971ae', 'volume_name': 'volume-66240825-9bf4-4c85-9dcd-05936ea971ae', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5433cc5b-e3ef-4d86-89df-c5169015b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5433cc5b-e3ef-4d86-89df-c5169015b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0f9de-80a5-4f5d-b459-2383f31b53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 66240825-9bf4-4c85-9dcd-05936ea971ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66240825-9bf4-4c85-9dcd-05936ea971ae', 'volume_size': 1} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1082605321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66240825-9bf4-4c85-9dcd-05936ea971ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:36Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 66240825-9bf4-4c85-9dcd-05936ea971ae {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:36 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:37 devstack quobyte-client[83627]: System call of process 96652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:37 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=78, name=volume-66240825-9bf4-4c85-9dcd-05936ea971ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324" returned: 0 in 0.597s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:37 devstack quobyte-client[83627]: System call of process 96657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:37 devstack quobyte-client[83627]: System call of process 96657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:37 devstack quobyte-client[83627]: System call of process 96657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:37 devstack quobyte-client[83627]: System call of process 96657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae 1073741824" returned: 0 in 0.451s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.380s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae" returned: 0 in 0.203s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324.8cd9a199-660b-4e9b-b2c0-90a08ffaa182" returned: 0 in 0.242s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0f9de-80a5-4f5d-b459-2383f31b53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66240825-9bf4-4c85-9dcd-05936ea971ae', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417c739b-c750-4d98-ba5e-dee0e77950fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-8cd9a199-660b-4e9b-b2c0-90a08ffaa182" released by "_delete_snapshot" :: held 2.351s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" released by "delete_snapshot" :: held 2.390s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:37 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-66240825-9bf4-4c85-9dcd-05936ea971ae (66240825-9bf4-4c85-9dcd-05936ea971ae): created successfully Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417c739b-c750-4d98-ba5e-dee0e77950fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (66241abe-63fa-43f2-b1b7-2d444be7e95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a645181d-d425-4f90-9b37-2c7720ac98a9 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:38 devstack cinder-volume[83624]: WARNING cinder.quota [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1929417425 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1929417425, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:49:38 devstack cinder-volume[83624]: WARNING cinder.quota [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1929417425 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1929417425, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['48258643-4247-48a3-832e-0669c87c1bac', 'a5377657-0740-41d6-a5ab-56b0362b0a4e', '3ea4c630-82aa-4695-ae60-47dd6c059d25', '2ba9a9d0-6cd8-4af7-89ca-3b11a3cc8ea4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['fb48b65b-581c-49fc-848d-85129fe73d55', 'd03a2473-89e6-4f99-a798-409cb8925ad8', 'bdd46bff-8cf3-4220-928c-2f5dab67d357', '50e9d507-1abc-4159-815d-9b1f929c237c'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6d895ca9-27b3-434b-a8cc-4f93af95d400 tempest-GroupSnapshotsTest-1215085635 None] group_snapshot 4b9107c2-bbd5-49c5-9593-7b26f95b29a1: deleted successfully Sep 26 17:49:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (0cb6ebb2-0214-46be-8409-2e634cf6da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af96e54-4216-4ea1-96c1-3a39c2ee87b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af96e54-4216-4ea1-96c1-3a39c2ee87b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696607988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679129c7-5dd7-4929-acf8-86c7a435c90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:39Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf80abbf-d046-4957-84e7-d5839411f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf80abbf-d046-4957-84e7-d5839411f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1200828d-293c-4e47-afbf-c65f0e800b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1200828d-293c-4e47-afbf-c65f0e800b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679129c7-5dd7-4929-acf8-86c7a435c90f', 'volume_name': 'volume-679129c7-5dd7-4929-acf8-86c7a435c90f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80e25ef-237a-46ca-9b54-2f0cd8b24344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80e25ef-237a-46ca-9b54-2f0cd8b24344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2595fab-7c5e-40e7-8c58-81ae6a83a683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:39 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 679129c7-5dd7-4929-acf8-86c7a435c90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679129c7-5dd7-4929-acf8-86c7a435c90f', 'volume_size': 1} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696607988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679129c7-5dd7-4929-acf8-86c7a435c90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:39Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 679129c7-5dd7-4929-acf8-86c7a435c90f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:39 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:39 devstack quobyte-client[83627]: System call of process 96663 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:39 devstack quobyte-client[83627]: System call of process 96663 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:39 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=79, name=volume-679129c7-5dd7-4929-acf8-86c7a435c90f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f 1073741824" returned: 0 in 0.664s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:39 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (aaa53d20-e18c-4155-b03a-28d3cefb53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6af2481-a4af-4984-8144-aa33ce2e0ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f" returned: 0 in 0.631s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (1378ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (a0430ee0-5617-41b2-9f14-14ffca38dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a09a3a-ff67-4703-9aae-4816c00485cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (d50bef14-06b3-4eeb-a91c-15a38a60289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a52689e-ada2-437d-996d-de3a7bd579ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a52689e-ada2-437d-996d-de3a7bd579ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1772384576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a12e5f1-db77-4a71-b9e0-7f9161b4d170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269f923-e8cf-4a60-ad55-15f9939666a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269f923-e8cf-4a60-ad55-15f9939666a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de1b44-05b1-43f6-a02e-de0ca0c548df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de1b44-05b1-43f6-a02e-de0ca0c548df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a12e5f1-db77-4a71-b9e0-7f9161b4d170', 'volume_name': 'volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3117a12-0478-4e96-aed6-538e319a3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3117a12-0478-4e96-aed6-538e319a3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994a6f48-b20e-4887-b79f-081ff75223c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Volume 9a12e5f1-db77-4a71-b9e0-7f9161b4d170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170', 'volume_size': 1} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1772384576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a12e5f1-db77-4a71-b9e0-7f9161b4d170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc70ee375994586abbb37743412fc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='1029329eefa64356a7d9ae3168fc276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Creating volume 9a12e5f1-db77-4a71-b9e0-7f9161b4d170 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:40 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:40 devstack quobyte-client[83627]: System call of process 96670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:40 devstack quobyte-client[83627]: System call of process 96670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:40 devstack quobyte-client[83627]: System call of process 96670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:40 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=80, name=volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6af2481-a4af-4984-8144-aa33ce2e0ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449839103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf5646f-ecb7-42ef-81a5-ea0351694c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:39Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9a3c5a-9230-43be-ba90-7ecf8d536406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9a3c5a-9230-43be-ba90-7ecf8d536406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74057ef8-1772-4412-9627-3bdc0f2e1d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74057ef8-1772-4412-9627-3bdc0f2e1d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf5646f-ecb7-42ef-81a5-ea0351694c41', 'volume_name': 'volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441e9ee3-73f8-43ee-856f-643cb09d5d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441e9ee3-73f8-43ee-856f-643cb09d5d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a34f50-03af-40fc-a891-7da369d885c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 4cf5646f-ecb7-42ef-81a5-ea0351694c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41', 'volume_size': 1} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a09a3a-ff67-4703-9aae-4816c00485cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226655232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2578bc1f-6e47-4bc0-9b88-7504223dd46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71550435-d2ca-47ac-82ee-fa0f775e6eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71550435-d2ca-47ac-82ee-fa0f775e6eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a6032b-47ff-45ab-ab05-0d2def4ef8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a6032b-47ff-45ab-ab05-0d2def4ef8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2578bc1f-6e47-4bc0-9b88-7504223dd46e', 'volume_name': 'volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa117b3a-9c08-4cef-b3a8-5ff024ea8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa117b3a-9c08-4cef-b3a8-5ff024ea8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb90aca9-5318-43fc-818f-f429597d8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 2578bc1f-6e47-4bc0-9b88-7504223dd46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e', 'volume_size': 1} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" acquired by "delete_volume" :: waited 0.922s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[55accc28-488c-4c73-9a4c-18eb8f5fc875]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 1073741824" returned: 0 in 0.888s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2595fab-7c5e-40e7-8c58-81ae6a83a683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679129c7-5dd7-4929-acf8-86c7a435c90f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a203cc7-0a19-4ecf-aa5e-1cad60503959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (99fbb160-4636-496b-b78e-b8d95cff700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe4914-8c5c-4398-b946-80f64fe4f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-679129c7-5dd7-4929-acf8-86c7a435c90f (679129c7-5dd7-4929-acf8-86c7a435c90f): created successfully Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a203cc7-0a19-4ecf-aa5e-1cad60503959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (0cb6ebb2-0214-46be-8409-2e634cf6da0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (1a5a0ac6-6f7a-4663-a5db-a68625ea03c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533aa81e-9235-4d55-b30a-98a6f4c3569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" returned: 0 in 0.642s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] <== create_volume: return (1640ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe4914-8c5c-4398-b946-80f64fe4f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468790825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bc69a9-3813-42b6-836a-9f697feba7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09327f95-0b83-4641-9c74-6a94b517043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09327f95-0b83-4641-9c74-6a94b517043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196f0eb4-72c3-46a5-86a8-633ed5f4f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196f0eb4-72c3-46a5-86a8-633ed5f4f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bc69a9-3813-42b6-836a-9f697feba7d0', 'volume_name': 'volume-96bc69a9-3813-42b6-836a-9f697feba7d0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b27e36b-f8e8-4a09-b123-b184e0387890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b27e36b-f8e8-4a09-b123-b184e0387890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1914b848-8287-4a6a-a4bf-84a18ac5b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 96bc69a9-3813-42b6-836a-9f697feba7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bc69a9-3813-42b6-836a-9f697feba7d0', 'volume_size': 1} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468790825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bc69a9-3813-42b6-836a-9f697feba7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 96bc69a9-3813-42b6-836a-9f697feba7d0 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:42 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:42 devstack quobyte-client[83627]: System call of process 96677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:42 devstack quobyte-client[83627]: System call of process 96677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:42 devstack quobyte-client[83627]: System call of process 96677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:42 devstack quobyte-client[83627]: System call of process 96677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:42 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=81, name=volume-96bc69a9-3813-42b6-836a-9f697feba7d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878" returned: 0 in 1.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533aa81e-9235-4d55-b30a-98a6f4c3569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774782868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13913dd7-4c40-4769-9be5-56bf72a213a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:41Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413464b6-3325-4f26-9ad6-a0ce5fc01e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413464b6-3325-4f26-9ad6-a0ce5fc01e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868e935a-6370-4109-acf4-2db7fe62d9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868e935a-6370-4109-acf4-2db7fe62d9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13913dd7-4c40-4769-9be5-56bf72a213a4', 'volume_name': 'volume-13913dd7-4c40-4769-9be5-56bf72a213a4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b605678-e766-446d-855c-233f66ce337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b605678-e766-446d-855c-233f66ce337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8333b0-b203-4110-9279-c0014df3d620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume 13913dd7-4c40-4769-9be5-56bf72a213a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13913dd7-4c40-4769-9be5-56bf72a213a4', 'volume_size': 1} Sep 26 17:49:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7b1fcfb2-953e-4495-9f85-4830e303a63a tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994a6f48-b20e-4887-b79f-081ff75223c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e1ebd0-33fa-49b3-8e60-3f55c3d72639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0 1073741824" returned: 0 in 0.776s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d27e05ed-9416-4a66-a9eb-4c81d1508878" returned: 0 in 0.464s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Volume volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 (9a12e5f1-db77-4a71-b9e0-7f9161b4d170): created successfully Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e1ebd0-33fa-49b3-8e60-3f55c3d72639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Flow 'volume_create_manager' (d50bef14-06b3-4eeb-a91c-15a38a60289e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-d27e05ed-9416-4a66-a9eb-4c81d1508878" released by "delete_volume" :: held 2.080s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0" returned: 0 in 0.376s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (1174ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226655232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2578bc1f-6e47-4bc0-9b88-7504223dd46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:40Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 2578bc1f-6e47-4bc0-9b88-7504223dd46e {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:43 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:43 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-10a0fca6-c3f1-4eec-a652-1ed1e5a9a8ff tempest-AttachVolumeTestJSON-361234456 None] Created volume successfully. Sep 26 17:49:43 devstack quobyte-client[83627]: System call of process 96682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:43 devstack quobyte-client[83627]: System call of process 96682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:43 devstack quobyte-client[83627]: System call of process 96682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:43 devstack quobyte-client[83627]: System call of process 96682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:43 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=82, name=volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" acquired by "delete_volume" :: waited 0.417s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1914b848-8287-4a6a-a4bf-84a18ac5b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bc69a9-3813-42b6-836a-9f697feba7d0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c59949a-2f9c-445a-9e21-c9d90d2f2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5185a-2de8-438e-b1e1-23080a6ced5e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e 1073741824" returned: 0 in 0.768s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-96bc69a9-3813-42b6-836a-9f697feba7d0 (96bc69a9-3813-42b6-836a-9f697feba7d0): created successfully Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c59949a-2f9c-445a-9e21-c9d90d2f2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (99fbb160-4636-496b-b78e-b8d95cff700a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e" returned: 0 in 0.376s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (1199ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.679s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449839103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf5646f-ecb7-42ef-81a5-ea0351694c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:39Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 4cf5646f-ecb7-42ef-81a5-ea0351694c41 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:44 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack quobyte-client[83627]: System call of process 96689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=83, name=volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb90aca9-5318-43fc-818f-f429597d8727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ab9f29-3bfa-4587-8718-3e14f4d5be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fe45d897-ce11-45ac-b424-44b02fa0bd89 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e (2578bc1f-6e47-4bc0-9b88-7504223dd46e): created successfully Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ab9f29-3bfa-4587-8718-3e14f4d5be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (a0430ee0-5617-41b2-9f14-14ffca38dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324" returned: 0 in 1.153s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cd701aa3-5e04-43a2-9ba1-cf601715630f tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 1073741824" returned: 0 in 0.729s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-ec71e99b-0a7b-40e9-bdc3-78053892a324" returned: 0 in 0.355s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ec71e99b-0a7b-40e9-bdc3-78053892a324" released by "delete_volume" :: held 1.857s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41" returned: 0 in 0.435s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (1192ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774782868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13913dd7-4c40-4769-9be5-56bf72a213a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8de2dacead41db83eadf765d4d80a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:41Z,use_quota=True,user_id='609035c1b86b469f9b84224785d044f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Creating volume 13913dd7-4c40-4769-9be5-56bf72a213a4 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:45 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:46 devstack quobyte-client[83627]: System call of process 96694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:46 devstack quobyte-client[83627]: System call of process 96694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:46 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=84, name=volume-13913dd7-4c40-4769-9be5-56bf72a213a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a34f50-03af-40fc-a891-7da369d885c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0176965-9d17-4028-bffd-f6fc6239ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:46 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 (4cf5646f-ecb7-42ef-81a5-ea0351694c41): created successfully Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0176965-9d17-4028-bffd-f6fc6239ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (aaa53d20-e18c-4155-b03a-28d3cefb53da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9a04f749-9eb6-446a-8780-5328f3e80beb tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4 1073741824" returned: 0 in 0.492s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4" returned: 0 in 0.327s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] <== create_volume: return (862ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['23c9b0ff-ff9f-44ee-91c2-7dc79e5603c3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8333b0-b203-4110-9279-c0014df3d620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13913dd7-4c40-4769-9be5-56bf72a213a4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a789e389-f2aa-4770-a5b0-0c34a98a691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:46 devstack cinder-volume[83624]: WARNING cinder.quota [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1929417425 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1929417425, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:49:46 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume volume-13913dd7-4c40-4769-9be5-56bf72a213a4 (13913dd7-4c40-4769-9be5-56bf72a213a4): created successfully Sep 26 17:49:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a789e389-f2aa-4770-a5b0-0c34a98a691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Flow 'volume_create_manager' (1a5a0ac6-6f7a-4663-a5db-a68625ea03c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['18e7de08-8420-443f-97fc-f3ba3e28bc67', '0bd746b2-c6b3-4358-980a-b1e77ba8b1ba', 'a6ab236d-6b86-4463-ac59-e82831ed6a6a', '4ec25150-4b49-4ab8-a6fb-63e62a7b8768'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ec6d86aa-a615-4c54-ba15-86703a0c0b88 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created volume successfully. Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['a5ce0c43-517e-4161-9a58-afce90d3adb7', 'bd7df818-f847-4a45-bbbf-abdf3ca68020', '16d17076-57c5-43e4-b91b-644274243e17', '3e736f63-dea5-467d-9ba6-f9ff19143424'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.166s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:47 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-febb748f-f1e6-4fc7-a30c-1f1617d0c766 tempest-GroupSnapshotsTest-1215085635 None] Delete group completed successfully. Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-13913dd7-4c40-4769-9be5-56bf72a213a4-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-13913dd7-4c40-4769-9be5-56bf72a213a4-delete_volume" acquired by "delete_volume" :: waited 0.219s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-13913dd7-4c40-4769-9be5-56bf72a213a4" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8f9a4daf-e4ec-4a8a-b40d-404189930f45 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8f9a4daf-e4ec-4a8a-b40d-404189930f45 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-1483483003: creating Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-13913dd7-4c40-4769-9be5-56bf72a213a4" acquired by "delete_volume" :: waited 0.092s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[39439bc4-f7af-4094-ab39-f28720437c5d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf789b-26fb-4090-8dd0-7618f60486a8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8f9a4daf-e4ec-4a8a-b40d-404189930f45 tempest-GroupSnapshotsTest-1215085635 None] Group tempest-GroupSnapshotsTest-Group-1483483003: created successfully Sep 26 17:49:49 devstack quobyte-client[83627]: System call of process 96722 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8f9a4daf-e4ec-4a8a-b40d-404189930f45 tempest-GroupSnapshotsTest-1215085635 None] Create group completed successfully. Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4" returned: 0 in 0.704s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-13913dd7-4c40-4769-9be5-56bf72a213a4" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:49 devstack quobyte-client[83627]: System call of process 96723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:49 devstack quobyte-client[83627]: System call of process 96723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:49 devstack quobyte-client[83627]: System call of process 96723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-13913dd7-4c40-4769-9be5-56bf72a213a4" released by "delete_volume" :: held 0.996s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" returned: 0 in 0.876s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.129s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c9debe5-555a-40ba-b822-065113e08456', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:49:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['31fec52e-cdfe-4d36-90e0-7450ec158216', '7c295891-bf1e-4379-a072-4a2f3a345b39', '5b87276d-f198-46ff-8e25-5ea5f0e91fb0', 'd82238c8-966f-4c4d-b820-2e273fdb9f08'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (eb73697f-9e29-45d1-a578-a1a0e91a25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bbb40c-c2a0-45f5-89f4-eb2caff25f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=152,cinder:SELECT=143,cinder:INSERT=27,cinder:DELETE=13 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bbb40c-c2a0-45f5-89f4-eb2caff25f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959212856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef5b5068-2413-442c-9fd1-b319dfce9673,host='devstack@QuobyteHD#QuobyteHD',id=5c37e31a-1565-4242-af67-4175bf52d978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:50Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b516d4bd-c639-4338-b510-7dd9c213d73f),volume_type_id=b516d4bd-c639-4338-b510-7dd9c213d73f)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0eb683-ebb5-4028-aeeb-63c2d9c073fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0eb683-ebb5-4028-aeeb-63c2d9c073fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd48b68-da61-4a9e-8bdf-80e5e939ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd48b68-da61-4a9e-8bdf-80e5e939ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c37e31a-1565-4242-af67-4175bf52d978', 'volume_name': 'volume-5c37e31a-1565-4242-af67-4175bf52d978', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40b6929-0d83-4329-97d6-3acf8126586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40b6929-0d83-4329-97d6-3acf8126586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01104960-bed4-416c-80b4-0363ab756582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Volume 5c37e31a-1565-4242-af67-4175bf52d978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c37e31a-1565-4242-af67-4175bf52d978', 'volume_size': 1} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef5b5068-2413-442c-9fd1-b319dfce9673,created_at=2025-09-26T15:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959212856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef5b5068-2413-442c-9fd1-b319dfce9673,host='devstack@QuobyteHD#QuobyteHD',id=5c37e31a-1565-4242-af67-4175bf52d978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20755a1e779b408c8bb152ad7a3b1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:49:50Z,use_quota=True,user_id='86b83561ca9e4effb67bdf9bc94c2388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b516d4bd-c639-4338-b510-7dd9c213d73f),volume_type_id=b516d4bd-c639-4338-b510-7dd9c213d73f)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Creating volume 5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:49:50 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:50 devstack quobyte-client[83627]: System call of process 96729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:50 devstack quobyte-client[83627]: System call of process 96729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:50 devstack quobyte-client[83627]: System call of process 96729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:50 devstack quobyte-client[83627]: System call of process 96729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:50 devstack quobyte-client[83627]: System call of process 96729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:50 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=85, name=volume-5c37e31a-1565-4242-af67-4175bf52d978, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-55166014-c4d1-408f-8ce2-812b531bf2d5 req-43567589-afb4-4f1f-87a1-cd583b12831b tempest-AttachVolumeTestJSON-361234456 None] attachment_update completed successfully. Sep 26 17:49:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 1073741824" returned: 0 in 0.505s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.201s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978" returned: 0 in 0.367s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] <== create_volume: return (913ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01104960-bed4-416c-80b4-0363ab756582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c37e31a-1565-4242-af67-4175bf52d978', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1a7497-07e8-490b-8641-35c4ad0b0d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0a5e7ab4-c0e6-4208-9b7d-7d179304c978 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-13913dd7-4c40-4769-9be5-56bf72a213a4-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-96bc69a9-3813-42b6-836a-9f697feba7d0-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-96bc69a9-3813-42b6-836a-9f697feba7d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:51 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Volume volume-5c37e31a-1565-4242-af67-4175bf52d978 (5c37e31a-1565-4242-af67-4175bf52d978): created successfully Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1a7497-07e8-490b-8641-35c4ad0b0d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Flow 'volume_create_manager' (eb73697f-9e29-45d1-a578-a1a0e91a25ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:49:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-13aefb44-7191-4037-b743-9057f065d193 tempest-GroupSnapshotsTest-1215085635 None] Created volume successfully. Sep 26 17:49:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-96bc69a9-3813-42b6-836a-9f697feba7d0" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-96bc69a9-3813-42b6-836a-9f697feba7d0" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb140fbe-9862-441c-86c6-166abef8f3fa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0" returned: 0 in 0.489s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-96bc69a9-3813-42b6-836a-9f697feba7d0" returned: 0 in 0.141s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-96bc69a9-3813-42b6-836a-9f697feba7d0" released by "delete_volume" :: held 0.824s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['4424ac35-982c-48a3-b319-6f014cecbc0c', '00d61b9c-4ed3-4a69-8f56-f0ddaf25303c', '51f56a54-bd0e-40e5-a229-1114b344be69', '8c8e88bb-6616-4c9c-873e-c227fa7a198a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] GroupSnapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: creating. Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.317s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Group snapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: creating. {{(pid=83624) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Creating offline snapshot ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e of volume 5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ffc6878d-01c9-4668-9736-3c9f1fee7f2e tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-96bc69a9-3813-42b6-836a-9f697feba7d0-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf633a-4aa8-4415-8c60-f3c913775145]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-2578bc1f-6e47-4bc0-9b88-7504223dd46e-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-2578bc1f-6e47-4bc0-9b88-7504223dd46e-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:54 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-2578bc1f-6e47-4bc0-9b88-7504223dd46e" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-2578bc1f-6e47-4bc0-9b88-7504223dd46e" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:54 devstack quobyte-client[83627]: System call of process 96769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b38cf-8d30-4134-a501-7258a97f739a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:54 devstack quobyte-client[83627]: System call of process 96769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:54 devstack quobyte-client[83627]: System call of process 96769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:54 devstack quobyte-client[83627]: System call of process 96769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978" returned: 0 in 0.727s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:54 devstack quobyte-client[83627]: System call of process 96773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:54 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=86, name=volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e 1G" returned: 0 in 0.344s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5c37e31a-1565-4242-af67-4175bf52d978 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:55 devstack quobyte-client[83627]: System call of process 96772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:55 devstack quobyte-client[83627]: System call of process 96772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:55 devstack quobyte-client[83627]: System call of process 96772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e" returned: 0 in 0.691s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack quobyte-client[83627]: System call of process 96777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img rebase -u -b volume-5c37e31a-1565-4242-af67-4175bf52d978 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 0.252s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2578bc1f-6e47-4bc0-9b88-7504223dd46e" returned: 0 in 0.192s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 0.186s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-2578bc1f-6e47-4bc0-9b88-7504223dd46e" released by "delete_volume" :: held 1.217s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 0.320s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.info" returned: 0 in 0.403s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['54ca7f39-7a3f-406b-81d0-f15b3e64040b', '68990379-1261-47fa-93fb-39b819dcd8c8', 'd45e1f2c-4e40-45f3-a0ef-92adddb2f341', '5d00ef2c-f62b-48fe-96f2-a59b57c5343d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.info" returned: 0 in 0.446s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.089s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:49:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-4cf5646f-ecb7-42ef-81a5-ea0351694c41-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] group_snapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: deleting Sep 26 17:49:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2e190513-30cb-440a-b9c3-800ccb5bf8bf tempest-GroupSnapshotsTest-1215085635 None] group_snapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: created successfully Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.986s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:49:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-4cf5646f-ecb7-42ef-81a5-ea0351694c41-delete_volume" acquired by "delete_volume" :: waited 0.291s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] group_snapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: deleting {{(pid=83624) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-58582763-9690-43cd-b223-e399fc811489 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-2578bc1f-6e47-4bc0-9b88-7504223dd46e-delete_volume" released by "delete_volume" :: held 4.498s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-4cf5646f-ecb7-42ef-81a5-ea0351694c41" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-4cf5646f-ecb7-42ef-81a5-ea0351694c41" acquired by "delete_volume" :: waited 0.041s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Deleting offline snapshot ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e of volume 5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] snapshot_file for this snap is: volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc858c-4f83-4b62-b84a-29db576d6c18]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc50bb-8854-4f74-9dc4-fb77cdf80584]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:49:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:49:59 devstack quobyte-client[83627]: System call of process 96796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:59 devstack quobyte-client[83627]: System call of process 96796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:49:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41" returned: 0 in 0.865s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:49:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:00 devstack quobyte-client[83627]: System call of process 96801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4cf5646f-ecb7-42ef-81a5-ea0351694c41" returned: 0 in 0.252s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-4cf5646f-ecb7-42ef-81a5-ea0351694c41" released by "delete_volume" :: held 1.333s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 1.225s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c37e31a-1565-4242-af67-4175bf52d978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[925a5485-c764-47fb-82a4-fda5d958c607]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['53bf69da-5da1-4db4-abd9-2f1c9bcf4231', '57a5830f-10d7-4a0e-8e38-0c6f462db894', '41912c93-e8a9-49c2-a475-7c4bf4c9a1b9', 'b666537f-b82b-441c-88cd-3ad854c0917d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978" returned: 0 in 0.924s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:01 devstack quobyte-client[83627]: System call of process 96818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.267s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:01 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 0.358s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4d733fe1-4f05-43c7-9d34-45faca409486 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-4cf5646f-ecb7-42ef-81a5-ea0351694c41-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978.ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" returned: 0 in 0.233s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-ecc449ac-9ac0-4567-ac56-b4e9fdc9a41e" released by "_delete_snapshot" :: held 3.201s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" released by "delete_snapshot" :: held 3.250s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-679129c7-5dd7-4929-acf8-86c7a435c90f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-679129c7-5dd7-4929-acf8-86c7a435c90f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:02 devstack cinder-volume[83624]: WARNING cinder.quota [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-768019688 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-768019688, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:50:02 devstack cinder-volume[83624]: WARNING cinder.quota [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-768019688 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-768019688, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:50:02 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-679129c7-5dd7-4929-acf8-86c7a435c90f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-679129c7-5dd7-4929-acf8-86c7a435c90f" acquired by "delete_volume" :: waited 0.025s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['1a221a0d-4b3f-4c21-95c6-e679b5bfc1c0', '230efd3b-a0d3-4e6b-9405-56563bf2ecb5', 'e494129b-d084-4d42-9bc4-a427f9bf8540', '443cf5ed-2f70-46b1-bfd1-e900d39a73fd'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9ae3b-22ff-4aa0-8822-2a50f79f8d57]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1c767d1e-b19e-41a7-a370-4a13820d904b tempest-GroupSnapshotsTest-1215085635 None] group_snapshot a7be467d-7fb3-4bd7-93f4-4759bfb4628e: deleted successfully Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f" returned: 0 in 0.536s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-679129c7-5dd7-4929-acf8-86c7a435c90f" returned: 0 in 0.091s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-679129c7-5dd7-4929-acf8-86c7a435c90f" released by "delete_volume" :: held 0.784s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['fdbbaa93-e92f-4823-85d9-1cfcdd433e4c', '6609a5b3-0e99-48e1-80c6-c36711f8d569', '965a0568-1eff-436f-b9dc-a507caad5964', 'b15db015-9f9e-4846-95c5-8b05134c2624'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:03 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:50:04 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-14caca12-0d46-4ed6-a077-ad1383941068 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-679129c7-5dd7-4929-acf8-86c7a435c90f-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f328e69-236d-41a7-abaa-350655404f43]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-66240825-9bf4-4c85-9dcd-05936ea971ae-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-66240825-9bf4-4c85-9dcd-05936ea971ae-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978" returned: 0 in 0.552s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5c37e31a-1565-4242-af67-4175bf52d978" returned: 0 in 0.317s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "cinder-quobyte-66240825-9bf4-4c85-9dcd-05936ea971ae" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Lock "cinder-quobyte-5c37e31a-1565-4242-af67-4175bf52d978" released by "delete_volume" :: held 1.010s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-66240825-9bf4-4c85-9dcd-05936ea971ae" acquired by "delete_volume" :: waited 0.082s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc661a87-66e4-4c5c-99a8-7ed97ce07186]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['9ceef2b5-7334-4b9f-b9e2-eced5a039997'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:05 devstack cinder-volume[83624]: WARNING cinder.quota [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-768019688 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-768019688, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Created reservations ['095a41fd-68bc-4110-b7cd-6a296fd03ca2', '8db5bf49-60c3-4039-b7bf-7987849e6b68', '926c5a60-87d6-42ee-8ebe-505031cf2573', '42778ce7-66a5-44b0-9c1f-4a7b8b20126b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae" returned: 0 in 0.563s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-66240825-9bf4-4c85-9dcd-05936ea971ae" returned: 0 in 0.214s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-quobyte-66240825-9bf4-4c85-9dcd-05936ea971ae" released by "delete_volume" :: held 0.948s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Created reservations ['8eca5ca3-78c2-4afc-9753-afba922a4ba1', 'fef0de49-257e-4b01-9859-f4bcc9c1a8a2', '3605cbd0-71e0-4686-ad6a-023e4f008182', 'e3e70aea-a7b2-4e8b-9875-ccacedd4ae66'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.390s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Deleted volume successfully. Sep 26 17:50:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.346s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f2831c63-2587-4f1c-8d91-e108cbdfe4de tempest-GroupSnapshotsTest-1215085635 None] Delete group completed successfully. Sep 26 17:50:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ef891415-e87d-4d73-99a4-efb9c743f887 tempest-CreateVolumesFromSourceVolumeTest-1485916842 None] Lock "cinder-66240825-9bf4-4c85-9dcd-05936ea971ae-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.141s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Flow 'volume_create_manager' (b5433ece-562c-4b3e-9a20-9b8e4ddf86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee431230-5b2a-4afa-9c1d-5e5f4ee389a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee431230-5b2a-4afa-9c1d-5e5f4ee389a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc08d386-e4ca-4bd5-91b6-1589d77fe3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cedb274d9b4461b8beaff71bbde046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:10Z,use_quota=True,user_id='9fad920ae4524d4092778201d32efc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2e236-5ce6-4a54-94ac-3e23b90f9a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef2e236-5ce6-4a54-94ac-3e23b90f9a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4fa994-a520-4d73-972c-ed817c98b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4fa994-a520-4d73-972c-ed817c98b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc08d386-e4ca-4bd5-91b6-1589d77fe3e6', 'volume_name': 'volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66e35f-2004-4652-8eef-4d4a04eab630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66e35f-2004-4652-8eef-4d4a04eab630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eab0ab7-e94b-4d92-a7d0-9d8c54080ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Volume dc08d386-e4ca-4bd5-91b6-1589d77fe3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6', 'volume_size': 1} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc08d386-e4ca-4bd5-91b6-1589d77fe3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cedb274d9b4461b8beaff71bbde046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:10Z,use_quota=True,user_id='9fad920ae4524d4092778201d32efc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Creating volume dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:50:10 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:50:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:10 devstack quobyte-client[83627]: System call of process 96839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:10 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=88, name=volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 1073741824" returned: 0 in 0.389s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" returned: 0 in 0.118s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] <== create_volume: return (646ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eab0ab7-e94b-4d92-a7d0-9d8c54080ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f724ab6d-3981-4cef-a1ab-27fc3075669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:11 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Volume volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 (dc08d386-e4ca-4bd5-91b6-1589d77fe3e6): created successfully Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f724ab6d-3981-4cef-a1ab-27fc3075669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Flow 'volume_create_manager' (b5433ece-562c-4b3e-9a20-9b8e4ddf86ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6b541fa9-8111-4e8e-a10e-1371dc33c221 tempest-CinderUnicodeTest-467570962 None] Created volume successfully. Sep 26 17:50:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Flow 'volume_create_manager' (332d0845-15ce-4b68-8535-3b5a152385cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d225d8-6893-42dc-a58d-06c61dc77528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d225d8-6893-42dc-a58d-06c61dc77528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-672518127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bcff04-df74-417d-93f1-8bff8617fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cedb274d9b4461b8beaff71bbde046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:13Z,use_quota=True,user_id='9fad920ae4524d4092778201d32efc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbc15d6-98f7-41d4-b5c2-3dc7fc57cc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbc15d6-98f7-41d4-b5c2-3dc7fc57cc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31254de-8a2f-432c-85e5-92da1e465f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31254de-8a2f-432c-85e5-92da1e465f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22bcff04-df74-417d-93f1-8bff8617fad5', 'volume_name': 'volume-22bcff04-df74-417d-93f1-8bff8617fad5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b5d5db-76c1-4ec2-a0cb-ed8b50df3223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b5d5db-76c1-4ec2-a0cb-ed8b50df3223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454fc978-a49f-48d7-b8f0-38a8f55e9f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:13 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Volume 22bcff04-df74-417d-93f1-8bff8617fad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22bcff04-df74-417d-93f1-8bff8617fad5', 'volume_size': 1} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-672518127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bcff04-df74-417d-93f1-8bff8617fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cedb274d9b4461b8beaff71bbde046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:13Z,use_quota=True,user_id='9fad920ae4524d4092778201d32efc23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Creating volume 22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:50:13 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:13 devstack quobyte-client[83627]: System call of process 96843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:13 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=89, name=volume-22bcff04-df74-417d-93f1-8bff8617fad5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 1073741824" returned: 0 in 0.517s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5" returned: 0 in 0.159s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:50:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454fc978-a49f-48d7-b8f0-38a8f55e9f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22bcff04-df74-417d-93f1-8bff8617fad5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3ab22e-33c3-4b9c-a302-f033064d64b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:14 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Volume volume-22bcff04-df74-417d-93f1-8bff8617fad5 (22bcff04-df74-417d-93f1-8bff8617fad5): created successfully Sep 26 17:50:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3ab22e-33c3-4b9c-a302-f033064d64b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Flow 'volume_create_manager' (332d0845-15ce-4b68-8535-3b5a152385cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:14 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-aa15318b-3bed-4e06-baa0-75ab9010f6b9 tempest-CinderUnicodeTest-467570962 None] Created volume successfully. Sep 26 17:50:15 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Creating offline snapshot a0961e07-4ae5-40f0-bc3c-e4c8c447c698 of volume 22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:50:15 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e7361-e516-4cb2-9fb1-ca3a1147c783]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5" returned: 0 in 0.495s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:16 devstack quobyte-client[83627]: System call of process 96850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=90, name=volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 1G" returned: 0 in 0.306s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): qemu-img rebase -u -b volume-22bcff04-df74-417d-93f1-8bff8617fad5 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:16 devstack quobyte-client[83627]: System call of process 96853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "qemu-img rebase -u -b volume-22bcff04-df74-417d-93f1-8bff8617fad5 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.183s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.info" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.info" returned: 0 in 0.098s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:17 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:INSERT=38,cinder:UPDATE=192,cinder:SELECT=139,cinder:DELETE=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:50:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-039afff4-7b98-416d-b25a-f3d4bf91b983 tempest-CinderUnicodeTest-467570962 None] Create snapshot completed successfully Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-a0961e07-4ae5-40f0-bc3c-e4c8c447c698-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-a0961e07-4ae5-40f0-bc3c-e4c8c447c698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-quobyte-a0961e07-4ae5-40f0-bc3c-e4c8c447c698" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-a0961e07-4ae5-40f0-bc3c-e4c8c447c698" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Deleting offline snapshot a0961e07-4ae5-40f0-bc3c-e4c8c447c698 of volume 22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] snapshot_file for this snap is: volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46084e8-deaf-46cf-a615-82aa05bc0869]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:19 devstack quobyte-client[83627]: System call of process 96863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:19 devstack quobyte-client[83627]: System call of process 96863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.396s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22bcff04-df74-417d-93f1-8bff8617fad5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c345d0-3410-44ec-9e2b-0fac583db6d8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5" returned: 0 in 0.406s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:19 devstack quobyte-client[83627]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:19 devstack quobyte-client[83627]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.282s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5.a0961e07-4ae5-40f0-bc3c-e4c8c447c698" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-a0961e07-4ae5-40f0-bc3c-e4c8c447c698" released by "_delete_snapshot" :: held 1.551s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" released by "delete_snapshot" :: held 1.607s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:20 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Created reservations ['0668697a-c687-4ffb-8fc3-a622b039812a', 'facc2686-0edc-48fe-819e-f9858d64e048', 'dfec2250-bb97-494e-933a-6a35c6680ac7', 'c11d9d61-54ea-41a5-8e0e-c8239d8857d9'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Delete snapshot completed successfully. Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4a143ffa-6f5d-4c4d-b356-4f5156f1a6ef tempest-CinderUnicodeTest-467570962 None] Lock "cinder-a0961e07-4ae5-40f0-bc3c-e4c8c447c698-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-3ffc6c6f-3e31-42ef-8e0f-4b1d2b9854be req-f076e392-411b-41ed-9649-cbc31fd2f8d1 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-3ffc6c6f-3e31-42ef-8e0f-4b1d2b9854be req-f076e392-411b-41ed-9649-cbc31fd2f8d1 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-3ffc6c6f-3e31-42ef-8e0f-4b1d2b9854be req-f076e392-411b-41ed-9649-cbc31fd2f8d1 tempest-AttachVolumeTestJSON-361234456 None] Terminate volume connection completed successfully. Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-3ffc6c6f-3e31-42ef-8e0f-4b1d2b9854be req-f076e392-411b-41ed-9649-cbc31fd2f8d1 tempest-AttachVolumeTestJSON-361234456 None] Deleting attachment 37f8162a-a173-4a71-b712-72734a9dad46. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-22bcff04-df74-417d-93f1-8bff8617fad5-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-22bcff04-df74-417d-93f1-8bff8617fad5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d8373a-9e3c-4b44-a136-5c85b0991b94]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5" returned: 0 in 0.450s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-22bcff04-df74-417d-93f1-8bff8617fad5" returned: 0 in 0.141s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-22bcff04-df74-417d-93f1-8bff8617fad5" released by "delete_volume" :: held 0.777s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Created reservations ['d6b78589-c546-4a3a-8d0c-735ffd5296b7', 'befa6938-dfaa-475e-9560-131f80cdc9da', '7786c049-5714-49f3-98f3-161a4dec7843', '84b5029f-934f-4b64-b82f-201d0f713ba3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.119s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Deleted volume successfully. Sep 26 17:50:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a82d24e-3e24-40f9-afd2-a03ccc5e06b9 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-22bcff04-df74-417d-93f1-8bff8617fad5-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "cinder-quobyte-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a4157-4d9e-4413-9136-4409bc9fae33]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" returned: 0 in 0.572s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" returned: 0 in 0.148s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:25 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-quobyte-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6" released by "delete_volume" :: held 0.936s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:25 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Created reservations ['2ddc754f-c03d-45c6-aab2-1f5827229da1', 'a96144fd-3865-43e4-9802-0c23642aca3b', 'f874b7b7-09be-43f5-bf2e-63e4bea70b90', '8f70fb01-b715-4b08-b72d-d08f7abd54d4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.091s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:26 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Deleted volume successfully. Sep 26 17:50:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e48cd0af-a9f4-42cf-ac08-c7069a0b3aa0 tempest-CinderUnicodeTest-467570962 None] Lock "cinder-dc08d386-e4ca-4bd5-91b6-1589d77fe3e6-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Flow 'volume_create_manager' (b84c1cd3-b83b-4c83-a542-11e4308c05f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0c6733-bdfc-45e8-8c0e-bf8c0df68ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0c6733-bdfc-45e8-8c0e-bf8c0df68ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-865593616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9447425f-19a5-4269-b538-fdd077f80b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5c0b14f1ad4af282a346c0604ed7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:34Z,use_quota=True,user_id='f2d96c04db1b4a528adaaf266a10af5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311e463-896d-4c92-85c6-1c872946d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311e463-896d-4c92-85c6-1c872946d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6381fd-fa7d-4deb-a4f2-dcfe210a5232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6381fd-fa7d-4deb-a4f2-dcfe210a5232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9447425f-19a5-4269-b538-fdd077f80b3c', 'volume_name': 'volume-9447425f-19a5-4269-b538-fdd077f80b3c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79bf55-be63-428f-afda-deab0eec0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79bf55-be63-428f-afda-deab0eec0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad8593a-fe60-497e-933e-2fb969b12c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:34 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Volume 9447425f-19a5-4269-b538-fdd077f80b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9447425f-19a5-4269-b538-fdd077f80b3c', 'volume_size': 1} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-865593616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9447425f-19a5-4269-b538-fdd077f80b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5c0b14f1ad4af282a346c0604ed7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:34Z,use_quota=True,user_id='f2d96c04db1b4a528adaaf266a10af5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Creating volume 9447425f-19a5-4269-b538-fdd077f80b3c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:50:34 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:34 devstack quobyte-client[83627]: System call of process 96923 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:34 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=92, name=volume-9447425f-19a5-4269-b538-fdd077f80b3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c 1073741824" returned: 0 in 0.332s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c" returned: 0 in 0.088s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:50:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad8593a-fe60-497e-933e-2fb969b12c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9447425f-19a5-4269-b538-fdd077f80b3c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e9879d-1ef1-4bf4-8590-5a6458b5e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Volume volume-9447425f-19a5-4269-b538-fdd077f80b3c (9447425f-19a5-4269-b538-fdd077f80b3c): created successfully Sep 26 17:50:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e9879d-1ef1-4bf4-8590-5a6458b5e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Flow 'volume_create_manager' (b84c1cd3-b83b-4c83-a542-11e4308c05f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:35 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d4bc14ae-eab0-4e99-8018-da176597571d tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Created volume successfully. Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Acquiring lock "cinder-9447425f-19a5-4269-b538-fdd077f80b3c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "cinder-9447425f-19a5-4269-b538-fdd077f80b3c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:37 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Acquiring lock "cinder-quobyte-9447425f-19a5-4269-b538-fdd077f80b3c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "cinder-quobyte-9447425f-19a5-4269-b538-fdd077f80b3c" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b2df4-dac3-46a9-911c-3baa017840d4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c" returned: 0 in 0.401s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9447425f-19a5-4269-b538-fdd077f80b3c" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "cinder-quobyte-9447425f-19a5-4269-b538-fdd077f80b3c" released by "delete_volume" :: held 0.658s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Created reservations ['180e10bf-1cb6-440a-9d47-c3a5a24341a7', 'd66425e6-8fca-4d23-8d40-aa060d43287c', '48270c78-2684-4aea-89e3-8d0efab02f56', '36130fab-6a82-4d74-a43f-cae7d65c7a84'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Deleted volume successfully. Sep 26 17:50:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ddae2896-819f-4687-ba75-a16677f93dde tempest-VolumeQuotasNegativeTestJSON-1571945090 None] Lock "cinder-9447425f-19a5-4269-b538-fdd077f80b3c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Flow 'volume_create_manager' (8f2caaad-7e2a-49be-90de-e5e4a8af88b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cee810-3867-4399-82a5-ab909b7bad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cee810-3867-4399-82a5-ab909b7bad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1983766167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5629c0f-f413-4a11-8186-9ec572cfc0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18be2f9f5ba49d7bc25ad94b64ceb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:44Z,use_quota=True,user_id='132524aa7b1d49ffa5363ea524006b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eae4cafd-f8a0-45cc-9ca2-6fd2c0e15406),volume_type_id=eae4cafd-f8a0-45cc-9ca2-6fd2c0e15406)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee867f-ab0f-4624-936d-3a743e296419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee867f-ab0f-4624-936d-3a743e296419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b124d6ce-b6c4-4d31-b8cb-509cf77c3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b124d6ce-b6c4-4d31-b8cb-509cf77c3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5629c0f-f413-4a11-8186-9ec572cfc0a4', 'volume_name': 'volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe96029-1ff0-4c8f-8926-6e98d93bfded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe96029-1ff0-4c8f-8926-6e98d93bfded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f57159b-3dd5-4991-aad7-38b9956ef53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume c5629c0f-f413-4a11-8186-9ec572cfc0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4', 'volume_size': 1} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1983766167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5629c0f-f413-4a11-8186-9ec572cfc0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18be2f9f5ba49d7bc25ad94b64ceb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:50:44Z,use_quota=True,user_id='132524aa7b1d49ffa5363ea524006b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eae4cafd-f8a0-45cc-9ca2-6fd2c0e15406),volume_type_id=eae4cafd-f8a0-45cc-9ca2-6fd2c0e15406)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Creating volume c5629c0f-f413-4a11-8186-9ec572cfc0a4 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:50:44 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:44 devstack quobyte-client[83627]: System call of process 96934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:44 devstack quobyte-client[83627]: System call of process 96934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:44 devstack quobyte-client[83627]: System call of process 96934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:44 devstack quobyte-client[83627]: System call of process 96934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=93, name=volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 1073741824" returned: 0 in 0.338s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4" returned: 0 in 0.090s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] <== create_volume: return (495ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f57159b-3dd5-4991-aad7-38b9956ef53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63e3262-7e89-40da-8aa7-563ac939a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:50:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 (c5629c0f-f413-4a11-8186-9ec572cfc0a4): created successfully Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63e3262-7e89-40da-8aa7-563ac939a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:50:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Flow 'volume_create_manager' (8f2caaad-7e2a-49be-90de-e5e4a8af88b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:50:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-de6a1cba-ea9d-476d-8ea5-12fee94bd638 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Created volume successfully. Sep 26 17:50:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-12b8456e-4e30-4a5d-a733-1345677741a7 req-bfbdb4b3-7367-4439-8c80-82be951da123 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-12b8456e-4e30-4a5d-a733-1345677741a7 req-bfbdb4b3-7367-4439-8c80-82be951da123 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-12b8456e-4e30-4a5d-a733-1345677741a7 req-bfbdb4b3-7367-4439-8c80-82be951da123 tempest-AttachVolumeTestJSON-361234456 None] Terminate volume connection completed successfully. Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-12b8456e-4e30-4a5d-a733-1345677741a7 req-bfbdb4b3-7367-4439-8c80-82be951da123 tempest-AttachVolumeTestJSON-361234456 None] Deleting attachment 0c9debe5-555a-40ba-b822-065113e08456. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:50:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:46 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0f154d82-391a-44b6-8646-2540e6b67092 tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Retype volume completed successfully. Sep 26 17:50:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "cinder-c5629c0f-f413-4a11-8186-9ec572cfc0a4-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "cinder-c5629c0f-f413-4a11-8186-9ec572cfc0a4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "cinder-quobyte-c5629c0f-f413-4a11-8186-9ec572cfc0a4" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "cinder-quobyte-c5629c0f-f413-4a11-8186-9ec572cfc0a4" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce9057-27ce-4278-a048-c40fad3bfb29]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:48 devstack quobyte-client[83627]: System call of process 96942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4" returned: 0 in 0.478s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c5629c0f-f413-4a11-8186-9ec572cfc0a4" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "cinder-quobyte-c5629c0f-f413-4a11-8186-9ec572cfc0a4" released by "delete_volume" :: held 0.770s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:49 devstack cinder-volume[83624]: WARNING cinder.quota [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:50:49 devstack cinder-volume[83624]: WARNING cinder.quota [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Created reservations ['b34becda-8a24-4171-8c42-8a2e736408ea', 'aac0604e-e30b-4ee1-b560-ff398a6c32a7', '8ad1dd37-cc97-4c79-a7ab-45b6207701b4', '3bde6568-bef9-4896-979a-fbec62f4fc2b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.199s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:50:49 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:50:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Deleted volume successfully. Sep 26 17:50:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f219b579-2594-46bc-b5b8-45efd4e5290a tempest-VolumeRetypeWithoutMigrationTest-909314490 None] Lock "cinder-c5629c0f-f413-4a11-8186-9ec572cfc0a4-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:50:59 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=98,cinder:DELETE=10,cinder:SELECT=83,cinder:INSERT=22 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=37,cinder:INSERT=10,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-9a12e5f1-db77-4a71-b9e0-7f9161b4d170-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-9a12e5f1-db77-4a71-b9e0-7f9161b4d170-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:00 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-quobyte-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[827df69f-7538-4a87-9204-3bdd279f7b5f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" returned: 0 in 0.448s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" returned: 0 in 0.121s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-9a12e5f1-db77-4a71-b9e0-7f9161b4d170" released by "delete_volume" :: held 0.732s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:01 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Created reservations ['7564d1b7-71c8-4d98-bf42-18355b695b26', '3d1c47c0-39d4-4985-bf5b-0f00d91a4e93', '1c6a350e-7c7a-454e-bf33-7f62a93710b5', '05c683a6-33be-4972-ae84-49e7429f5a3b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.151s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Deleted volume successfully. Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-047e9d60-87aa-49b0-8415-f6eb2ecbb1c3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-9a12e5f1-db77-4a71-b9e0-7f9161b4d170-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-bdb6b471-9d7a-46e1-b77d-beabbb5a2097-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-bdb6b471-9d7a-46e1-b77d-beabbb5a2097-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:02 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-quobyte-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d57fa0-e1c6-4cc2-922f-0207a683f77e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:03 devstack quobyte-client[83627]: System call of process 97006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" returned: 0 in 0.462s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" returned: 0 in 0.104s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-bdb6b471-9d7a-46e1-b77d-beabbb5a2097" released by "delete_volume" :: held 0.743s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Created reservations ['03b815ff-0c8e-478a-a10a-1b65f3fd2b1e', '7a70dda6-df8b-40e2-ad9e-128b1e2c599a', 'f7149c4c-24f3-452f-bd09-ca860a2583fa', '5048fad3-ef5f-4c39-8074-634bf4cdf45e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Deleted volume successfully. Sep 26 17:51:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6dd1e586-a03b-451e-a28c-e91786588379 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-bdb6b471-9d7a-46e1-b77d-beabbb5a2097-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-af168c31-b727-4b97-bcf7-4d7793d145f1-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-af168c31-b727-4b97-bcf7-4d7793d145f1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "cinder-quobyte-af168c31-b727-4b97-bcf7-4d7793d145f1" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-af168c31-b727-4b97-bcf7-4d7793d145f1" acquired by "delete_volume" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf3230-c306-4bb2-a17b-c4b04565482c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1" returned: 0 in 0.479s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-af168c31-b727-4b97-bcf7-4d7793d145f1" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-quobyte-af168c31-b727-4b97-bcf7-4d7793d145f1" released by "delete_volume" :: held 0.764s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Created reservations ['e500abca-9c97-4229-af65-ff9dba514284', '23c2fb6d-76e3-459d-9ec7-a5740e5995a0', 'bd2908d7-c782-482e-ad8b-ae16bb5dfb13', '4fd5b12f-8703-44db-8ee4-7b42b2d9e903'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.093s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:06 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Deleted volume successfully. Sep 26 17:51:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1987acb3-88be-4a61-83d3-c898fdb6dcb3 tempest-AttachVolumeTestJSON-361234456 None] Lock "cinder-af168c31-b727-4b97-bcf7-4d7793d145f1-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.147s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:16 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=28,cinder:SELECT=15,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:51:16 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:51:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-809ab486-9e29-4150-a320-d46823c0b518 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-809ab486-9e29-4150-a320-d46823c0b518 tempest-GroupsTest-682141716 None] Group tempest-Group1-225000566: creating Sep 26 17:51:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-809ab486-9e29-4150-a320-d46823c0b518 tempest-GroupsTest-682141716 None] Group tempest-Group1-225000566: created successfully Sep 26 17:51:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-809ab486-9e29-4150-a320-d46823c0b518 tempest-GroupsTest-682141716 None] Create group completed successfully. Sep 26 17:51:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e571228f-4059-4c79-bc1f-4daf277c9215 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e571228f-4059-4c79-bc1f-4daf277c9215 tempest-GroupsTest-682141716 None] Group tempest-Group2-1576709965: creating Sep 26 17:51:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e571228f-4059-4c79-bc1f-4daf277c9215 tempest-GroupsTest-682141716 None] Group tempest-Group2-1576709965: created successfully Sep 26 17:51:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e571228f-4059-4c79-bc1f-4daf277c9215 tempest-GroupsTest-682141716 None] Create group completed successfully. Sep 26 17:51:23 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (f38f4c49-c426-4cf9-b6de-93702e096ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb8607b-4dec-44da-b1f6-09da787705f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb8607b-4dec-44da-b1f6-09da787705f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780675196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2c20980-3875-4ae4-be58-46d15184916b,host='devstack@QuobyteHD#QuobyteHD',id=6ace01f7-4fac-4b16-8c27-a0131827b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:24Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61fef04d-149b-4f80-9199-2f0c576de6d9),volume_type_id=61fef04d-149b-4f80-9199-2f0c576de6d9)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd69b47-de47-4542-a792-25c1f52cb509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd69b47-de47-4542-a792-25c1f52cb509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0d3b1c-e569-45a9-9a32-cb1665ece9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0d3b1c-e569-45a9-9a32-cb1665ece9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ace01f7-4fac-4b16-8c27-a0131827b328', 'volume_name': 'volume-6ace01f7-4fac-4b16-8c27-a0131827b328', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1519fc4-4051-4390-a125-5523f1b8d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1519fc4-4051-4390-a125-5523f1b8d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5b340-d919-487b-a600-94b53ff5d30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:24 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Volume 6ace01f7-4fac-4b16-8c27-a0131827b328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ace01f7-4fac-4b16-8c27-a0131827b328', 'volume_size': 1} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2c20980-3875-4ae4-be58-46d15184916b,created_at=2025-09-26T15:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780675196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2c20980-3875-4ae4-be58-46d15184916b,host='devstack@QuobyteHD#QuobyteHD',id=6ace01f7-4fac-4b16-8c27-a0131827b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:24Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61fef04d-149b-4f80-9199-2f0c576de6d9),volume_type_id=61fef04d-149b-4f80-9199-2f0c576de6d9)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Creating volume 6ace01f7-4fac-4b16-8c27-a0131827b328 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:51:24 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:24 devstack quobyte-client[83627]: System call of process 97055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:24 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=94, name=volume-6ace01f7-4fac-4b16-8c27-a0131827b328, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328 1073741824" returned: 0 in 0.372s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.567s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b5b340-d919-487b-a600-94b53ff5d30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ace01f7-4fac-4b16-8c27-a0131827b328', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ea1dc6-d50f-48a0-b7cd-008ed3e799be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:24 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Volume volume-6ace01f7-4fac-4b16-8c27-a0131827b328 (6ace01f7-4fac-4b16-8c27-a0131827b328): created successfully Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ea1dc6-d50f-48a0-b7cd-008ed3e799be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:24 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (f38f4c49-c426-4cf9-b6de-93702e096ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:24 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e8f5c1df-2421-4cc6-9325-656ffba84e54 tempest-GroupsTest-682141716 None] Created volume successfully. Sep 26 17:51:26 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Acquiring lock "cinder-quobyte-6ace01f7-4fac-4b16-8c27-a0131827b328" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:26 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-6ace01f7-4fac-4b16-8c27-a0131827b328" acquired by "delete_volume" :: waited 0.045s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:26 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[611fae8a-875c-4f07-b640-d9b55cff7775]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:27 devstack quobyte-client[83627]: System call of process 97059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328" returned: 0 in 0.476s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6ace01f7-4fac-4b16-8c27-a0131827b328" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-6ace01f7-4fac-4b16-8c27-a0131827b328" released by "delete_volume" :: held 0.746s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Created reservations ['e717a014-cb90-4d2d-a507-c0a8ad738c86'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:27 devstack cinder-volume[83624]: WARNING cinder.quota [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-126735335 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-126735335, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:51:27 devstack cinder-volume[83624]: WARNING cinder.quota [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-126735335 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-126735335, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:51:27 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Created reservations ['19f3af0a-9ea1-4a88-bc04-6344fe269c6e', '511d5f78-4255-45dc-9ebc-812f2c8e13a9', '6f924a62-e373-4621-a4b9-e003465ab103', 'a8729af8-880f-4fc9-950a-c1627bb2f1f6'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.179s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:28 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d472a92a-99b6-41d2-b0cf-4783c25ed23d tempest-GroupsTest-682141716 None] Delete group completed successfully. Sep 26 17:51:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Created reservations ['3b4b0e6c-28ce-4ad1-afd6-9bc827e642aa'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.163s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:29 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:29 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-632d0b48-ec6a-4b4f-b018-cc0f07e95c0b tempest-GroupsTest-682141716 None] Delete group completed successfully. Sep 26 17:51:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f58abc31-ac86-456f-81ae-328734614b46 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f58abc31-ac86-456f-81ae-328734614b46 tempest-GroupsTest-682141716 None] Group tempest-GroupsTest-Group-1928532327: creating Sep 26 17:51:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f58abc31-ac86-456f-81ae-328734614b46 tempest-GroupsTest-682141716 None] Group tempest-GroupsTest-Group-1928532327: created successfully Sep 26 17:51:30 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f58abc31-ac86-456f-81ae-328734614b46 tempest-GroupsTest-682141716 None] Create group completed successfully. Sep 26 17:51:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (b93d385a-8782-40b4-84ee-21f9c8a3574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe041a-02bb-47cf-833a-439e63c4be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe041a-02bb-47cf-833a-439e63c4be02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125052898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,host='devstack@QuobyteHD#QuobyteHD',id=36af998a-63b7-4297-b0dd-d96c88f8e93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:32Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854728f1-24cd-4e0c-a594-f48ac7e04ca2),volume_type_id=854728f1-24cd-4e0c-a594-f48ac7e04ca2)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f551e-8220-4f10-8d6a-d0d24187a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f551e-8220-4f10-8d6a-d0d24187a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68be4c3d-c0f9-4558-ac84-d6c0d7757187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68be4c3d-c0f9-4558-ac84-d6c0d7757187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36af998a-63b7-4297-b0dd-d96c88f8e93a', 'volume_name': 'volume-36af998a-63b7-4297-b0dd-d96c88f8e93a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be260ec-f04f-4271-8301-b9659fa1cc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be260ec-f04f-4271-8301-b9659fa1cc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10522b79-ac27-4523-86a8-7a096f95e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Volume 36af998a-63b7-4297-b0dd-d96c88f8e93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36af998a-63b7-4297-b0dd-d96c88f8e93a', 'volume_size': 1} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,created_at=2025-09-26T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125052898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,host='devstack@QuobyteHD#QuobyteHD',id=36af998a-63b7-4297-b0dd-d96c88f8e93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:32Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854728f1-24cd-4e0c-a594-f48ac7e04ca2),volume_type_id=854728f1-24cd-4e0c-a594-f48ac7e04ca2)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Creating volume 36af998a-63b7-4297-b0dd-d96c88f8e93a {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:51:32 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:32 devstack quobyte-client[83627]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:32 devstack quobyte-client[83627]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:32 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=95, name=volume-36af998a-63b7-4297-b0dd-d96c88f8e93a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a 1073741824" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a" returned: 0 in 0.161s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] <== create_volume: return (629ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10522b79-ac27-4523-86a8-7a096f95e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36af998a-63b7-4297-b0dd-d96c88f8e93a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb397726-6024-4921-91d3-b67c84078612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Volume volume-36af998a-63b7-4297-b0dd-d96c88f8e93a (36af998a-63b7-4297-b0dd-d96c88f8e93a): created successfully Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb397726-6024-4921-91d3-b67c84078612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (b93d385a-8782-40b4-84ee-21f9c8a3574e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1054abf1-7d77-4c75-9dcc-c7a579e93d91 tempest-GroupsTest-682141716 None] Created volume successfully. Sep 26 17:51:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:34 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:51:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (93df26c9-bcbe-4edc-bcd2-7a4820fe390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5de0c5c-31c2-4f42-be7a-df47b560d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5de0c5c-31c2-4f42-be7a-df47b560d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088891055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,host='devstack@QuobyteHD#QuobyteHD',id=93ace186-6004-456e-978b-a05dd9da1f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:35Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854728f1-24cd-4e0c-a594-f48ac7e04ca2),volume_type_id=854728f1-24cd-4e0c-a594-f48ac7e04ca2)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b02ce5e-97ce-4dc5-90ff-0a09ab416a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b02ce5e-97ce-4dc5-90ff-0a09ab416a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59706d9c-1190-481e-ba62-ceebd198268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59706d9c-1190-481e-ba62-ceebd198268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ace186-6004-456e-978b-a05dd9da1f24', 'volume_name': 'volume-93ace186-6004-456e-978b-a05dd9da1f24', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51864bf-eb7c-45ef-9ff3-6e222479d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51864bf-eb7c-45ef-9ff3-6e222479d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa51606-9247-4b82-9754-6aa9e440afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Volume 93ace186-6004-456e-978b-a05dd9da1f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ace186-6004-456e-978b-a05dd9da1f24', 'volume_size': 1} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,created_at=2025-09-26T15:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088891055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66509d65-aaed-4bd0-9334-6a2a2eea483b,host='devstack@QuobyteHD#QuobyteHD',id=93ace186-6004-456e-978b-a05dd9da1f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38041c63d46146349f9c30f92b44c749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:51:35Z,use_quota=True,user_id='6acc3f604fa9458f8c5957e6e937b843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854728f1-24cd-4e0c-a594-f48ac7e04ca2),volume_type_id=854728f1-24cd-4e0c-a594-f48ac7e04ca2)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Creating volume 93ace186-6004-456e-978b-a05dd9da1f24 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:51:35 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:35 devstack quobyte-client[83627]: System call of process 97070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=96, name=volume-93ace186-6004-456e-978b-a05dd9da1f24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24 1073741824" returned: 0 in 0.426s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24" returned: 0 in 0.180s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:51:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa51606-9247-4b82-9754-6aa9e440afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ace186-6004-456e-978b-a05dd9da1f24', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d675444-d2bc-4fd9-914a-d582943e2f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:51:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Volume volume-93ace186-6004-456e-978b-a05dd9da1f24 (93ace186-6004-456e-978b-a05dd9da1f24): created successfully Sep 26 17:51:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d675444-d2bc-4fd9-914a-d582943e2f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:51:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Flow 'volume_create_manager' (93df26c9-bcbe-4edc-bcd2-7a4820fe390b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:51:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ba4806df-9e9b-4120-b365-8a63b70c6ed5 tempest-GroupsTest-682141716 None] Created volume successfully. Sep 26 17:51:37 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-25380c73-d62c-41c0-a659-9bcff38fde6d tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-25380c73-d62c-41c0-a659-9bcff38fde6d tempest-GroupsTest-682141716 None] Update group completed successfully. Sep 26 17:51:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bd323269-c8ed-4902-940d-96af465e52f5 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bd323269-c8ed-4902-940d-96af465e52f5 tempest-GroupsTest-682141716 None] Update group completed successfully. Sep 26 17:51:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Acquiring lock "cinder-quobyte-36af998a-63b7-4297-b0dd-d96c88f8e93a" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-36af998a-63b7-4297-b0dd-d96c88f8e93a" acquired by "delete_volume" :: waited 0.075s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef816871-da83-4e85-aa83-60303d75f381]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:40 devstack quobyte-client[83627]: System call of process 97075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a" returned: 0 in 0.456s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-36af998a-63b7-4297-b0dd-d96c88f8e93a" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-36af998a-63b7-4297-b0dd-d96c88f8e93a" released by "delete_volume" :: held 0.717s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Acquiring lock "cinder-quobyte-93ace186-6004-456e-978b-a05dd9da1f24" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-93ace186-6004-456e-978b-a05dd9da1f24" acquired by "delete_volume" :: waited 0.041s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4d9f5-b825-48c9-80bd-543313cac10a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24" returned: 0 in 0.410s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-93ace186-6004-456e-978b-a05dd9da1f24" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "cinder-quobyte-93ace186-6004-456e-978b-a05dd9da1f24" released by "delete_volume" :: held 0.685s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Created reservations ['0c8e3a50-456a-47a6-8ff8-b014eeb49470'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:42 devstack cinder-volume[83624]: WARNING cinder.quota [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1309477256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1309477256, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:51:42 devstack cinder-volume[83624]: WARNING cinder.quota [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1309477256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1309477256, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Created reservations ['65987fd6-82a6-4ece-a7c1-7eca5fb6052f', '2d1515b2-0b4d-4880-82c5-746689a698ac', 'ef0f315c-ad41-4c89-8be3-de4779d2cf74', '2bb98b48-2675-42e6-9a8f-75098bfd3340'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Created reservations ['76aae201-60e0-4a19-a0b2-6d4823bc3a83', 'd1b9f3db-0f4b-451c-a628-8f10f2cb68c9', '0976768a-6462-42b5-9fd2-8e3a507af0c6', '5c444be3-dc25-482c-84f2-74d23a6b3a1a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:42 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b3738e37-c471-4c45-aad9-5a807f9bce18 tempest-GroupsTest-682141716 None] Delete group completed successfully. Sep 26 17:51:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-755b84ae-2c23-4cbe-96b9-b1f6c3460f71 tempest-GroupsV320Test-1028427532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-755b84ae-2c23-4cbe-96b9-b1f6c3460f71 tempest-GroupsV320Test-1028427532 None] Group tempest-GroupsV320Test-Group-612277881: creating Sep 26 17:51:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-755b84ae-2c23-4cbe-96b9-b1f6c3460f71 tempest-GroupsV320Test-1028427532 None] Group tempest-GroupsV320Test-Group-612277881: created successfully Sep 26 17:51:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-755b84ae-2c23-4cbe-96b9-b1f6c3460f71 tempest-GroupsV320Test-1028427532 None] Create group completed successfully. Sep 26 17:51:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Created reservations ['07aece74-cfdd-4860-ac95-05bf43284c81'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.123s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:51:51 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:51:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d6e00b98-f48e-4cbc-af14-6295a5dd6e85 tempest-GroupsV320Test-1028427532 None] Delete group completed successfully. Sep 26 17:52:01 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=46,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:52:01 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=47,cinder:UPDATE=46,cinder:INSERT=10 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:52:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (92e8b5d1-7228-4143-95fb-76ffa486d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79398779-0175-4038-b43f-3b97ee2af1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79398779-0175-4038-b43f-3b97ee2af1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788292049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557e9546-c584-4892-ad67-f9dcfea0c050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:06Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acae3c97-9ef6-43d4-adaf-3f17463bdac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acae3c97-9ef6-43d4-adaf-3f17463bdac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61c75e-7be6-4263-b437-202873d79a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f61c75e-7be6-4263-b437-202873d79a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557e9546-c584-4892-ad67-f9dcfea0c050', 'volume_name': 'volume-557e9546-c584-4892-ad67-f9dcfea0c050', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c54c75-dc40-4037-bdea-b9ce3f51a1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c54c75-dc40-4037-bdea-b9ce3f51a1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c56e155-606e-45ba-8f48-3431d0be015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:06 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Volume 557e9546-c584-4892-ad67-f9dcfea0c050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557e9546-c584-4892-ad67-f9dcfea0c050', 'volume_size': 1} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788292049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557e9546-c584-4892-ad67-f9dcfea0c050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:06Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Creating volume 557e9546-c584-4892-ad67-f9dcfea0c050 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:06 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:06 devstack quobyte-client[83627]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:06 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=97, name=volume-557e9546-c584-4892-ad67-f9dcfea0c050, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050 1073741824" returned: 0 in 0.531s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050" returned: 0 in 0.142s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c56e155-606e-45ba-8f48-3431d0be015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557e9546-c584-4892-ad67-f9dcfea0c050', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c21732-f79e-4455-88e4-38b9c9a4f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:07 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Volume volume-557e9546-c584-4892-ad67-f9dcfea0c050 (557e9546-c584-4892-ad67-f9dcfea0c050): created successfully Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c21732-f79e-4455-88e4-38b9c9a4f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (92e8b5d1-7228-4143-95fb-76ffa486d49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-46408ee0-da48-48c7-80d5-7df2746ef034 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050" by "attach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050" acquired by "attach_volume" :: waited 0.061s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Attaching volume 557e9546-c584-4892-ad67-f9dcfea0c050 to instance 4457279f-f5d1-49fb-9e47-87c4602e4513 at mountpoint /dev/vdb on host None. Sep 26 17:52:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Attach volume completed successfully. Sep 26 17:52:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-27927651-0d6b-4a60-ab42-ebec953961fe tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050" released by "attach_volume" :: held 0.478s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:09 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Terminate volume connection completed successfully. Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.632s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Flow 'volume_create_manager' (cfef0583-c655-4b7c-97f5-7c2f63bfb889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50caa0ab-5b77-4df8-abe3-f9f8e726d1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50caa0ab-5b77-4df8-abe3-f9f8e726d1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-803998573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c1140c-16ad-4f96-948c-be38a4f02d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73050b7e0e914c54ab05625a205f33e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:10Z,use_quota=True,user_id='cd2f7a9e289040ed89fef8258a4be048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0a5a0e-0116-4bbc-840a-089668acca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0a5a0e-0116-4bbc-840a-089668acca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a87771-4b79-4ab7-b6be-752c661d6277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a87771-4b79-4ab7-b6be-752c661d6277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c1140c-16ad-4f96-948c-be38a4f02d4c', 'volume_name': 'volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09cfb12-5b87-4272-b460-874ae741913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09cfb12-5b87-4272-b460-874ae741913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05acf2eb-70fb-494c-9f2e-61312a90b174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume e5c1140c-16ad-4f96-948c-be38a4f02d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c', 'volume_size': 1} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-803998573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c1140c-16ad-4f96-948c-be38a4f02d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73050b7e0e914c54ab05625a205f33e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:10Z,use_quota=True,user_id='cd2f7a9e289040ed89fef8258a4be048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Creating volume e5c1140c-16ad-4f96-948c-be38a4f02d4c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:10 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:10 devstack quobyte-client[83627]: System call of process 97205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:10 devstack quobyte-client[83627]: System call of process 97205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:10 devstack quobyte-client[83627]: System call of process 97205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:10 devstack quobyte-client[83627]: System call of process 97205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:10 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=98, name=volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" by "detach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c 1073741824" returned: 0 in 0.503s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" acquired by "detach_volume" :: waited 0.263s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c" returned: 0 in 0.337s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Detaching volume 557e9546-c584-4892-ad67-f9dcfea0c050 from instance 4457279f-f5d1-49fb-9e47-87c4602e4513. Sep 26 17:52:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05acf2eb-70fb-494c-9f2e-61312a90b174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ab4c44-5896-4260-9067-5986eb6ca418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:11 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c (e5c1140c-16ad-4f96-948c-be38a4f02d4c): created successfully Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ab4c44-5896-4260-9067-5986eb6ca418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Flow 'volume_create_manager' (cfef0583-c655-4b7c-97f5-7c2f63bfb889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cffb97a2-d945-4a5f-b8a9-ccc22a06db74 tempest-VolumeQuotasAdminTestJSON-834873528 None] Created volume successfully. Sep 26 17:52:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Detach volume completed successfully. Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-12a80947-76bd-4f77-8ef6-4c4fb4f5eaf8 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" released by "detach_volume" :: held 0.487s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-787bed76-7db5-4d97-90f1-b6c103eb9214 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" by "detach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-787bed76-7db5-4d97-90f1-b6c103eb9214 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-787bed76-7db5-4d97-90f1-b6c103eb9214 tempest-VolumesActionsTest-1793252863 None] Volume detach called, but volume not attached. Sep 26 17:52:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-787bed76-7db5-4d97-90f1-b6c103eb9214 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "cinder-e5c1140c-16ad-4f96-948c-be38a4f02d4c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "cinder-e5c1140c-16ad-4f96-948c-be38a4f02d4c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:12 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "cinder-quobyte-e5c1140c-16ad-4f96-948c-be38a4f02d4c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "cinder-quobyte-e5c1140c-16ad-4f96-948c-be38a4f02d4c" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[741023c2-ae07-4282-9b05-794c04bbf688]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-quobyte-557e9546-c584-4892-ad67-f9dcfea0c050" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-quobyte-557e9546-c584-4892-ad67-f9dcfea0c050" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[38149155-a38c-43fa-8267-a7b748adcbf5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:13 devstack quobyte-client[83627]: System call of process 97209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c" returned: 0 in 1.318s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e5c1140c-16ad-4f96-948c-be38a4f02d4c" returned: 0 in 0.173s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "cinder-quobyte-e5c1140c-16ad-4f96-948c-be38a4f02d4c" released by "delete_volume" :: held 1.676s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:14 devstack quobyte-client[83627]: System call of process 97210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050" returned: 0 in 1.236s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Created reservations ['30e91bc4-9c89-4d80-a6fd-cdeff009f85a', 'a50e419b-9e8a-4812-ae36-05e12245b83c', '5b324580-9bda-4c10-8375-6cdf210253d3', 'eb8429e4-f744-4b27-95d2-1ece10104fa6'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-557e9546-c584-4892-ad67-f9dcfea0c050" returned: 0 in 0.340s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-quobyte-557e9546-c584-4892-ad67-f9dcfea0c050" released by "delete_volume" :: held 1.751s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.214s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Deleted volume successfully. Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Created reservations ['528f1923-bd1d-4fda-bd88-bf3fcebb83df', '3e2e8761-971d-4b11-bb61-3853b6673f79', 'e304107b-4b04-4542-8f27-7c888aa09764', '4b556599-342b-4ccd-a683-af5a51e9ccd8'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-232614db-a372-4a50-b608-fe7984066c66 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "cinder-e5c1140c-16ad-4f96-948c-be38a4f02d4c-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.185s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Deleted volume successfully. Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-77a688f7-8e89-4912-b10a-330b9877e978 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-557e9546-c584-4892-ad67-f9dcfea0c050-delete_volume" released by "delete_volume" :: held 3.745s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Flow 'volume_create_manager' (6e889a2f-4fb1-4234-9bae-873fdcc02d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59852a6-ad31-435c-92c8-8e39fd8eb68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59852a6-ad31-435c-92c8-8e39fd8eb68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1787012672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e994fb-b246-47ea-9092-c2e658ca6471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73050b7e0e914c54ab05625a205f33e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:16Z,use_quota=True,user_id='cd2f7a9e289040ed89fef8258a4be048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870ba232-1603-4952-ab6a-b2b95189f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870ba232-1603-4952-ab6a-b2b95189f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de169fd1-2505-44f2-96f1-035adba7b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de169fd1-2505-44f2-96f1-035adba7b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e994fb-b246-47ea-9092-c2e658ca6471', 'volume_name': 'volume-61e994fb-b246-47ea-9092-c2e658ca6471', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d79a53d-5e59-4447-8a51-3d986faef12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d79a53d-5e59-4447-8a51-3d986faef12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78ab685-c454-4f1c-9d56-a74db7568b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:16 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume 61e994fb-b246-47ea-9092-c2e658ca6471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e994fb-b246-47ea-9092-c2e658ca6471', 'volume_size': 1} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1787012672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e994fb-b246-47ea-9092-c2e658ca6471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73050b7e0e914c54ab05625a205f33e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:16Z,use_quota=True,user_id='cd2f7a9e289040ed89fef8258a4be048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Creating volume 61e994fb-b246-47ea-9092-c2e658ca6471 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:17 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:17 devstack quobyte-client[83627]: System call of process 97221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:17 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=99, name=volume-61e994fb-b246-47ea-9092-c2e658ca6471, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471 1073741824" returned: 0 in 0.393s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471" returned: 0 in 0.190s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] <== create_volume: return (708ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78ab685-c454-4f1c-9d56-a74db7568b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e994fb-b246-47ea-9092-c2e658ca6471', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fd5568-f90f-4c10-916e-d6d9af6e914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:18 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Volume volume-61e994fb-b246-47ea-9092-c2e658ca6471 (61e994fb-b246-47ea-9092-c2e658ca6471): created successfully Sep 26 17:52:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fd5568-f90f-4c10-916e-d6d9af6e914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Flow 'volume_create_manager' (6e889a2f-4fb1-4234-9bae-873fdcc02d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-17d116d6-64fe-433a-8e4b-2315ec96b3c8 tempest-VolumeQuotasAdminTestJSON-834873528 None] Created volume successfully. Sep 26 17:52:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2a860a62-b41d-4ae5-9002-1ccdbda23d36 tempest-VolumeQuotasAdminTestJSON-1058313301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2a860a62-b41d-4ae5-9002-1ccdbda23d36 tempest-VolumeQuotasAdminTestJSON-1058313301 None] Transfer volume completed successfully. Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Acquiring lock "cinder-61e994fb-b246-47ea-9092-c2e658ca6471-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "cinder-61e994fb-b246-47ea-9092-c2e658ca6471-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:21 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Acquiring lock "cinder-quobyte-61e994fb-b246-47ea-9092-c2e658ca6471" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "cinder-quobyte-61e994fb-b246-47ea-9092-c2e658ca6471" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e11dd6-45a8-47c1-ba0d-6c1d136bde97]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471" returned: 0 in 0.444s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-61e994fb-b246-47ea-9092-c2e658ca6471" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "cinder-quobyte-61e994fb-b246-47ea-9092-c2e658ca6471" released by "delete_volume" :: held 0.705s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Created reservations ['6cecf152-c784-41ea-a611-fdf175c931e5', 'fe314deb-d8a8-43cd-b322-8fc1a9fb80db', 'd6d0fbe7-7ef1-4b71-9f8e-103000a94322', '8533fca2-248a-4e04-80fe-d12ace0a3524'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.130s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:22 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Deleted volume successfully. Sep 26 17:52:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-83a6382b-dcde-4c78-969f-95b8e4ee7ae5 tempest-VolumeQuotasAdminTestJSON-874601781 None] Lock "cinder-61e994fb-b246-47ea-9092-c2e658ca6471-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:24 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (bcbb271d-435e-4446-9871-60144836aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e56a07-7db2-4487-a0dd-9975c14c4c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e56a07-7db2-4487-a0dd-9975c14c4c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583155517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04431574-1889-479a-a131-49aad7cc03b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:25Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2e9ea-f3be-4619-b05a-380c596637ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2e9ea-f3be-4619-b05a-380c596637ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeb30f9-f11a-4c85-b063-ae1db474ba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceeb30f9-f11a-4c85-b063-ae1db474ba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04431574-1889-479a-a131-49aad7cc03b3', 'volume_name': 'volume-04431574-1889-479a-a131-49aad7cc03b3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d031e1-b799-4dcf-8eee-ee0ffcddeadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d031e1-b799-4dcf-8eee-ee0ffcddeadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2713fd63-3433-419e-ae3c-e7666372c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:25 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Volume 04431574-1889-479a-a131-49aad7cc03b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04431574-1889-479a-a131-49aad7cc03b3', 'volume_size': 1} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583155517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04431574-1889-479a-a131-49aad7cc03b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:25Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Creating volume 04431574-1889-479a-a131-49aad7cc03b3 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:25 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:25 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=100, name=volume-04431574-1889-479a-a131-49aad7cc03b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3 1073741824" returned: 0 in 0.354s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3" returned: 0 in 0.145s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.590s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2713fd63-3433-419e-ae3c-e7666372c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04431574-1889-479a-a131-49aad7cc03b3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c5f242-907e-48c3-a630-0fa331b177d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:26 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Volume volume-04431574-1889-479a-a131-49aad7cc03b3 (04431574-1889-479a-a131-49aad7cc03b3): created successfully Sep 26 17:52:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c5f242-907e-48c3-a630-0fa331b177d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (bcbb271d-435e-4446-9871-60144836aea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:26 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3bd68d4a-5aa0-480a-b0ea-2e5452dc6952 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-04431574-1889-479a-a131-49aad7cc03b3-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "cinder-04431574-1889-479a-a131-49aad7cc03b3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-quobyte-04431574-1889-479a-a131-49aad7cc03b3" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-04431574-1889-479a-a131-49aad7cc03b3" acquired by "delete_volume" :: waited 0.020s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290eff7-d7eb-47f4-9536-cdc630a38a77]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3" returned: 0 in 0.466s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-04431574-1889-479a-a131-49aad7cc03b3" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-04431574-1889-479a-a131-49aad7cc03b3" released by "delete_volume" :: held 0.752s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Created reservations ['37595578-3c70-45b7-a23d-ab59bfaf4cb4', '4f67b863-542a-4cae-baa2-859c539359fd', 'fb772cb5-6bff-4aa7-aa22-ddf02905e198', '32d99fb0-1156-4c0c-8f45-14012ea91226'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.093s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:28 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:29 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Deleted volume successfully. Sep 26 17:52:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-bf5b59d2-4dfc-4a48-b06b-6c1e51eb1c8c tempest-VolumesActionsTest-1047766708 None] Lock "cinder-04431574-1889-479a-a131-49aad7cc03b3-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (97e783bf-bb33-4d77-b821-035beef56cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b753e398-d86a-4d49-a36a-fdc89a0a0e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b753e398-d86a-4d49-a36a-fdc89a0a0e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-452934338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833aa91-7834-4768-90b6-b21d6251a49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:30Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245805f2-b819-4f54-a242-9d620ca3ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245805f2-b819-4f54-a242-9d620ca3ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff84f8b6-dc5f-436a-ac0b-a20ce2a2b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff84f8b6-dc5f-436a-ac0b-a20ce2a2b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8833aa91-7834-4768-90b6-b21d6251a49b', 'volume_name': 'volume-8833aa91-7834-4768-90b6-b21d6251a49b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b1af27-e9c2-4e87-8220-73f06c09e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b1af27-e9c2-4e87-8220-73f06c09e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7f702-a4e7-4294-9cf4-e73963d2f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Volume 8833aa91-7834-4768-90b6-b21d6251a49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8833aa91-7834-4768-90b6-b21d6251a49b', 'volume_size': 1} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-452934338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833aa91-7834-4768-90b6-b21d6251a49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:30Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Creating volume 8833aa91-7834-4768-90b6-b21d6251a49b {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:30 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:30 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=101, name=volume-8833aa91-7834-4768-90b6-b21d6251a49b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b 1073741824" returned: 0 in 0.373s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (615ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7f702-a4e7-4294-9cf4-e73963d2f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8833aa91-7834-4768-90b6-b21d6251a49b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c125c66-af9d-4040-ad82-79d3c9997afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Volume volume-8833aa91-7834-4768-90b6-b21d6251a49b (8833aa91-7834-4768-90b6-b21d6251a49b): created successfully Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c125c66-af9d-4040-ad82-79d3c9997afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (97e783bf-bb33-4d77-b821-035beef56cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:31 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-27743e01-8c02-4d3f-9959-41b8501fa6c8 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:31 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Flow 'volume_create_manager' (b9fcdb3a-f0c7-4ed1-82a8-402c669347d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793d4bb-2b30-4f01-90e3-42face07cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793d4bb-2b30-4f01-90e3-42face07cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1475546586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7011a237-2987-447a-8153-41b3c4cea051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d3aedaae924f26a11aba0e34589413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:32Z,use_quota=True,user_id='07b8b940fa2f4cb8b327c683d9812fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355359f3-afd7-4f81-a5fa-d2d5389f313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355359f3-afd7-4f81-a5fa-d2d5389f313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e495f2-191f-47ea-b058-efd0737610e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e495f2-191f-47ea-b058-efd0737610e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7011a237-2987-447a-8153-41b3c4cea051', 'volume_name': 'volume-7011a237-2987-447a-8153-41b3c4cea051', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9fa3a8-228d-4d2d-9e93-40eb11dcea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9fa3a8-228d-4d2d-9e93-40eb11dcea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686635f-3d06-4a8f-86f3-5ef9b33119ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Volume 7011a237-2987-447a-8153-41b3c4cea051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7011a237-2987-447a-8153-41b3c4cea051', 'volume_size': 1} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1475546586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7011a237-2987-447a-8153-41b3c4cea051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d3aedaae924f26a11aba0e34589413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:32Z,use_quota=True,user_id='07b8b940fa2f4cb8b327c683d9812fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Creating volume 7011a237-2987-447a-8153-41b3c4cea051 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:32 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:32 devstack quobyte-client[83627]: System call of process 97317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:32 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=102, name=volume-7011a237-2987-447a-8153-41b3c4cea051, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-8833aa91-7834-4768-90b6-b21d6251a49b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051 1073741824" returned: 0 in 0.509s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-8833aa91-7834-4768-90b6-b21d6251a49b-delete_volume" acquired by "delete_volume" :: waited 0.195s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051" returned: 0 in 0.329s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] <== create_volume: return (861ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686635f-3d06-4a8f-86f3-5ef9b33119ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7011a237-2987-447a-8153-41b3c4cea051', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc20d8f-37f0-4205-aa2f-f1ef8588d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Volume volume-7011a237-2987-447a-8153-41b3c4cea051 (7011a237-2987-447a-8153-41b3c4cea051): created successfully Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc20d8f-37f0-4205-aa2f-f1ef8588d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Flow 'volume_create_manager' (b9fcdb3a-f0c7-4ed1-82a8-402c669347d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:33 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-quobyte-8833aa91-7834-4768-90b6-b21d6251a49b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-8833aa91-7834-4768-90b6-b21d6251a49b" acquired by "delete_volume" :: waited 0.024s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e5fa7aba-cc88-4602-a054-6ef50a90d5a5 tempest-VolumesServicesTestJSON-1432290083 None] Created volume successfully. Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d10df-b0e1-4891-87b2-c1d19fe758f3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:33 devstack quobyte-client[83627]: System call of process 97321 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b" returned: 0 in 0.505s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8833aa91-7834-4768-90b6-b21d6251a49b" returned: 0 in 0.088s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-8833aa91-7834-4768-90b6-b21d6251a49b" released by "delete_volume" :: held 0.758s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Acquiring lock "cinder-7011a237-2987-447a-8153-41b3c4cea051-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Created reservations ['184e47c9-0f89-4744-b224-13e310cc0ee3', 'c0f2112d-88d8-4277-bd40-60c5f7702291', 'f4f9c921-e8b2-4e96-8907-926ac7669949', 'fa09ea94-0413-4f99-9b8c-2cc0e57d3b0f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "cinder-7011a237-2987-447a-8153-41b3c4cea051-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:34 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Acquiring lock "cinder-quobyte-7011a237-2987-447a-8153-41b3c4cea051" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.180s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "cinder-quobyte-7011a237-2987-447a-8153-41b3c4cea051" acquired by "delete_volume" :: waited 0.286s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Deleted volume successfully. Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d64f0d0-bff8-40ad-915f-06241f76314a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a4acd5a9-311b-4739-a46e-aae9b8218a33 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-8833aa91-7834-4768-90b6-b21d6251a49b-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:35 devstack quobyte-client[83627]: System call of process 97326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:35 devstack quobyte-client[83627]: System call of process 97326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:35 devstack quobyte-client[83627]: System call of process 97326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:35 devstack quobyte-client[83627]: System call of process 97326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051" returned: 0 in 0.625s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (538528c2-2989-4d85-8657-5191faea8fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e5a9fd-d812-416e-bcff-2cdd0948d477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-7011a237-2987-447a-8153-41b3c4cea051" returned: 0 in 0.408s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e5a9fd-d812-416e-bcff-2cdd0948d477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120412201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f999ee4a-30c7-452d-8bbf-82d496c83529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:35Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11082e38-ad0e-450f-ac5f-5b4fd5ed357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11082e38-ad0e-450f-ac5f-5b4fd5ed357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd35e5e-98b3-49de-a5f9-858f8efb577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd35e5e-98b3-49de-a5f9-858f8efb577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f999ee4a-30c7-452d-8bbf-82d496c83529', 'volume_name': 'volume-f999ee4a-30c7-452d-8bbf-82d496c83529', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a560c98-3354-42a9-ade4-a8f1e62a253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a560c98-3354-42a9-ade4-a8f1e62a253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac47d00-4cca-4883-81ae-4786ade0fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Volume f999ee4a-30c7-452d-8bbf-82d496c83529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f999ee4a-30c7-452d-8bbf-82d496c83529', 'volume_size': 1} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120412201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f999ee4a-30c7-452d-8bbf-82d496c83529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:35Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Creating volume f999ee4a-30c7-452d-8bbf-82d496c83529 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:36 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:36 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=103, name=volume-f999ee4a-30c7-452d-8bbf-82d496c83529, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "cinder-quobyte-7011a237-2987-447a-8153-41b3c4cea051" released by "delete_volume" :: held 1.451s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529 1073741824" returned: 0 in 0.424s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529" returned: 0 in 0.263s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac47d00-4cca-4883-81ae-4786ade0fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f999ee4a-30c7-452d-8bbf-82d496c83529', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566cd16e-ded3-454a-acd2-9907163a32fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Volume volume-f999ee4a-30c7-452d-8bbf-82d496c83529 (f999ee4a-30c7-452d-8bbf-82d496c83529): created successfully Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566cd16e-ded3-454a-acd2-9907163a32fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (538528c2-2989-4d85-8657-5191faea8fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Created reservations ['0789a5c8-b5b8-433b-ba35-3deece1cf3bc', '67ab4faa-785d-4df4-9948-6c81e78b7a8d', '78fa8f4b-f3f7-4a12-940c-832b0bcab3f1', '18433a21-e323-4556-99ea-4d83a4a3c4e4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f40dab6a-1b94-4681-926c-548602294ba3 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Deleted volume successfully. Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47cadc9d-e632-4342-9ad4-fd3ca619a9d5 tempest-VolumesServicesTestJSON-1432290083 None] Lock "cinder-7011a237-2987-447a-8153-41b3c4cea051-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-f999ee4a-30c7-452d-8bbf-82d496c83529-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-f999ee4a-30c7-452d-8bbf-82d496c83529-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-quobyte-f999ee4a-30c7-452d-8bbf-82d496c83529" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-f999ee4a-30c7-452d-8bbf-82d496c83529" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425e4a9-96da-417b-8654-d43e1e6f32b1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529" returned: 0 in 0.493s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f999ee4a-30c7-452d-8bbf-82d496c83529" returned: 0 in 0.118s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-f999ee4a-30c7-452d-8bbf-82d496c83529" released by "delete_volume" :: held 0.800s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Created reservations ['5056edec-b57d-4959-899c-2dff37bac0c9', '0300db68-4f49-4003-afa6-dd8381d2ce68', '8ed01b4e-d4b5-46aa-b689-478c8a89800e', 'daa10589-2e17-492e-999b-a68387ca6846'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.112s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:39 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Deleted volume successfully. Sep 26 17:52:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1a73c06-f24e-4c4c-897f-6192764bc8e3 tempest-VolumesActionsTest-1047766708 None] Lock "cinder-f999ee4a-30c7-452d-8bbf-82d496c83529-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (a1c411bd-8890-468a-b1ac-48d8be141a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee39ac2-fe25-4839-9b67-71e5aabb03b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee39ac2-fe25-4839-9b67-71e5aabb03b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005288915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c8060b-574b-4290-b62a-565bfb2a182f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:41Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd87260-bd11-405c-8294-1c2054ec77ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd87260-bd11-405c-8294-1c2054ec77ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9115480a-e134-4568-bf55-e40358de858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9115480a-e134-4568-bf55-e40358de858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c8060b-574b-4290-b62a-565bfb2a182f', 'volume_name': 'volume-21c8060b-574b-4290-b62a-565bfb2a182f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc45ea6-470a-49fe-bfe4-d3deab737dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc45ea6-470a-49fe-bfe4-d3deab737dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46279ea-a282-4079-bc62-d454ae19000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:40 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Volume 21c8060b-574b-4290-b62a-565bfb2a182f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c8060b-574b-4290-b62a-565bfb2a182f', 'volume_size': 1} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005288915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c8060b-574b-4290-b62a-565bfb2a182f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:41Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Creating volume 21c8060b-574b-4290-b62a-565bfb2a182f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:40 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:41 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=104, name=volume-21c8060b-574b-4290-b62a-565bfb2a182f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f 1073741824" returned: 0 in 0.376s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f" returned: 0 in 0.098s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.570s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46279ea-a282-4079-bc62-d454ae19000e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c8060b-574b-4290-b62a-565bfb2a182f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d02842-a909-4a26-a524-a6679d85b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Volume volume-21c8060b-574b-4290-b62a-565bfb2a182f (21c8060b-574b-4290-b62a-565bfb2a182f): created successfully Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d02842-a909-4a26-a524-a6679d85b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (a1c411bd-8890-468a-b1ac-48d8be141a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a36c5d46-3407-4c67-a4a1-38a43bf33c96 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-21c8060b-574b-4290-b62a-565bfb2a182f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "cinder-21c8060b-574b-4290-b62a-565bfb2a182f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Acquiring lock "cinder-quobyte-21c8060b-574b-4290-b62a-565bfb2a182f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-21c8060b-574b-4290-b62a-565bfb2a182f" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[227f2548-9f3e-4b71-b9da-d2bdfed2bf9c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Flow 'volume_create_manager' (35c198a1-fb86-437a-bba4-cd1e927eafc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfad768-50a2-4c04-9653-054fe67595ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfad768-50a2-4c04-9653-054fe67595ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-746837050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b04eac0-e01a-4d14-b006-39e14b4378b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3945c0f5a6c4d6cad45adc07e57514c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:43Z,use_quota=True,user_id='2ec157d87670468988023b310118b16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abe901f-eb57-42c7-a1db-c47c90dc4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abe901f-eb57-42c7-a1db-c47c90dc4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5260174a-0779-4122-83ce-e610c928208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5260174a-0779-4122-83ce-e610c928208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b04eac0-e01a-4d14-b006-39e14b4378b5', 'volume_name': 'volume-0b04eac0-e01a-4d14-b006-39e14b4378b5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de48ac-d8b2-4513-86de-3f7e9eb06d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de48ac-d8b2-4513-86de-3f7e9eb06d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182203b-9381-4fc4-9d9e-b1bf82a23ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume 0b04eac0-e01a-4d14-b006-39e14b4378b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b04eac0-e01a-4d14-b006-39e14b4378b5', 'volume_size': 1} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-746837050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b04eac0-e01a-4d14-b006-39e14b4378b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3945c0f5a6c4d6cad45adc07e57514c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:43Z,use_quota=True,user_id='2ec157d87670468988023b310118b16f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Creating volume 0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:43 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f" returned: 0 in 0.768s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:43 devstack quobyte-client[83627]: System call of process 97348 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=105, name=volume-0b04eac0-e01a-4d14-b006-39e14b4378b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-21c8060b-574b-4290-b62a-565bfb2a182f" returned: 0 in 0.152s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "cinder-quobyte-21c8060b-574b-4290-b62a-565bfb2a182f" released by "delete_volume" :: held 1.104s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 1073741824" returned: 0 in 0.533s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5" returned: 0 in 0.274s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] <== create_volume: return (840ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182203b-9381-4fc4-9d9e-b1bf82a23ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b04eac0-e01a-4d14-b006-39e14b4378b5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b0d342-600c-4196-81a9-eabfeb9476f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 (0b04eac0-e01a-4d14-b006-39e14b4378b5): created successfully Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b0d342-600c-4196-81a9-eabfeb9476f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Flow 'volume_create_manager' (35c198a1-fb86-437a-bba4-cd1e927eafc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Created reservations ['63bec0f5-146f-4a54-959b-15aa65f71bb4', '64781e78-35a6-43db-8efe-55460773c06f', '62a58ca7-a526-4e4f-84c5-ed86fb2e14c6', '178d0e74-7d9f-434e-8b51-21856263ef8b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:44 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fec02e17-a29c-46dd-bc96-6eb69bf32c09 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Created volume successfully. Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.088s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Deleted volume successfully. Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-152d1b03-96b1-416f-ac78-79caee2c7c0b tempest-VolumesActionsTest-1047766708 None] Lock "cinder-21c8060b-574b-4290-b62a-565bfb2a182f-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Creating offline snapshot a7d89f71-7d3d-4873-ad25-7a0588f90ab2 of volume 0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:52:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (f3c9850e-5aae-47d8-8d5d-ff007d2a83b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c4a742-6c39-47ba-acc8-f2b321db0ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c4258-6980-4ded-81bb-9f765316d63b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c4a742-6c39-47ba-acc8-f2b321db0ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796099000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38be1a37-1e6b-4942-8577-91f6fe22c37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:46Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb6c230-27bd-4d4c-8118-22b4d35952f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb6c230-27bd-4d4c-8118-22b4d35952f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80748dd4-3c21-4ca4-b3a5-d12d7c49e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80748dd4-3c21-4ca4-b3a5-d12d7c49e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38be1a37-1e6b-4942-8577-91f6fe22c37b', 'volume_name': 'volume-38be1a37-1e6b-4942-8577-91f6fe22c37b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5d688-a677-482d-af80-4519919f989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5d688-a677-482d-af80-4519919f989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6805ba4-177d-4591-92f8-64b1b70241f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:46 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Volume 38be1a37-1e6b-4942-8577-91f6fe22c37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38be1a37-1e6b-4942-8577-91f6fe22c37b', 'volume_size': 1} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5" returned: 0 in 0.490s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:46 devstack quobyte-client[83627]: System call of process 97358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:46 devstack quobyte-client[83627]: System call of process 97358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:46 devstack quobyte-client[83627]: System call of process 97358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:46 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=106, name=volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 1G" returned: 0 in 0.257s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "qemu-img rebase -u -b volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:52:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.084s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.092s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.info" returned: 0 in 0.090s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.info" returned: 0 in 0.083s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.642s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796099000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38be1a37-1e6b-4942-8577-91f6fe22c37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f638474f4efd4e029a11d1e89681068e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:52:46Z,use_quota=True,user_id='80485067f89f4fb298011da2ea1561bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Creating volume 38be1a37-1e6b-4942-8577-91f6fe22c37b {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:52:47 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:52:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:47 devstack quobyte-client[83627]: System call of process 97368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:47 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=108, name=volume-38be1a37-1e6b-4942-8577-91f6fe22c37b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:52:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6cb75c21-39c6-488a-ae3c-a82cb1f791bb tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Create snapshot completed successfully Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b 1073741824" returned: 0 in 0.428s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b" returned: 0 in 0.129s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6805ba4-177d-4591-92f8-64b1b70241f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38be1a37-1e6b-4942-8577-91f6fe22c37b', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf7c56b-6eeb-4642-aeba-663e82e7a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:52:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Volume volume-38be1a37-1e6b-4942-8577-91f6fe22c37b (38be1a37-1e6b-4942-8577-91f6fe22c37b): created successfully Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf7c56b-6eeb-4642-aeba-663e82e7a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:52:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Flow 'volume_create_manager' (f3c9850e-5aae-47d8-8d5d-ff007d2a83b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:52:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9baeb4e5-47b6-4294-be91-b7c5090b9309 tempest-VolumesActionsTest-1793252863 None] Created volume successfully. Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "cinder-a7d89f71-7d3d-4873-ad25-7a0588f90ab2-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-a7d89f71-7d3d-4873-ad25-7a0588f90ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "cinder-quobyte-a7d89f71-7d3d-4873-ad25-7a0588f90ab2" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-a7d89f71-7d3d-4873-ad25-7a0588f90ab2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Deleting offline snapshot a7d89f71-7d3d-4873-ad25-7a0588f90ab2 of volume 0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] snapshot_file for this snap is: volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bc79b3-8be3-41c5-9c35-7aec30755b8a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-38be1a37-1e6b-4942-8577-91f6fe22c37b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.523s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b04eac0-e01a-4d14-b006-39e14b4378b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-38be1a37-1e6b-4942-8577-91f6fe22c37b-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01ea3f7-f9e9-4c38-8bc4-50b71f2b5874]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "cinder-quobyte-38be1a37-1e6b-4942-8577-91f6fe22c37b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-quobyte-38be1a37-1e6b-4942-8577-91f6fe22c37b" acquired by "delete_volume" :: waited 0.087s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5" returned: 0 in 0.624s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5592441b-ce44-4867-8463-35fa23f24140]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:50 devstack quobyte-client[83627]: System call of process 97379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.334s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5.a7d89f71-7d3d-4873-ad25-7a0588f90ab2" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-a7d89f71-7d3d-4873-ad25-7a0588f90ab2" released by "_delete_snapshot" :: held 1.942s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:51 devstack quobyte-client[83627]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:51 devstack quobyte-client[83627]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:51 devstack quobyte-client[83627]: System call of process 97381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" released by "delete_snapshot" :: held 1.969s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b" returned: 0 in 0.745s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-38be1a37-1e6b-4942-8577-91f6fe22c37b" returned: 0 in 0.256s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-quobyte-38be1a37-1e6b-4942-8577-91f6fe22c37b" released by "delete_volume" :: held 1.259s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Created reservations ['6c7598f6-6103-4907-8eb4-d0976c6eef39', '3ecd0207-18b8-4b78-a651-71ad7fb298c5', 'cb93618e-3a91-4b00-8f6e-9603b918b414', '2ee7c915-4ca3-46fc-b9b5-055b455c5533'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Created reservations ['c109ce97-5aba-46da-b49f-fb665a876195', 'dc30cc5a-5d53-44cc-b74c-13a05e134b22', 'edbe3256-e3bd-4692-99be-3bb04af993d9', '0f6403ee-c115-43d3-8a7c-63af6f3d279f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:52 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Delete snapshot completed successfully. Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a71108dc-e550-474a-9a62-b2605d1862f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-a7d89f71-7d3d-4873-ad25-7a0588f90ab2-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.085s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:52 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Deleted volume successfully. Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-52608c5f-a3b4-42b1-9f6c-0263cc9c7703 tempest-VolumesActionsTest-1793252863 None] Lock "cinder-38be1a37-1e6b-4942-8577-91f6fe22c37b-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "cinder-0b04eac0-e01a-4d14-b006-39e14b4378b5-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-0b04eac0-e01a-4d14-b006-39e14b4378b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1d947-45ae-4b92-ab32-70722b0f9878]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:52:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5" returned: 0 in 0.457s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0b04eac0-e01a-4d14-b006-39e14b4378b5" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-quobyte-0b04eac0-e01a-4d14-b006-39e14b4378b5" released by "delete_volume" :: held 0.766s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:52:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Created reservations ['adedf522-e3c5-413b-bfbb-ece23483e3db', '0cb29ed1-6363-4141-9871-75c97c4d1d7e', '77a1a891-8fcd-4144-aee2-69f0e7a4736b', 'c788f749-5fff-45e2-863c-0840068571a7'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:52:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Deleted volume successfully. Sep 26 17:52:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-03845e84-797c-4dd8-b3e2-a20d98ba3568 tempest-VolumeSnapshotQuotasNegativeTestJSON-723233313 None] Lock "cinder-0b04eac0-e01a-4d14-b006-39e14b4378b5-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=80,cinder:UPDATE=99,cinder:INSERT=27,cinder:DELETE=9 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=70,cinder:UPDATE=123,cinder:DELETE=12,cinder:INSERT=19 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:53:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Flow 'volume_create_manager' (1aaa9174-a233-4e2c-b2b0-9a8b6fba6209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ec6da1-41e7-4eca-91b2-5f00ceda4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ec6da1-41e7-4eca-91b2-5f00ceda4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1772375327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c37486-11c2-4c54-bc83-3c80a4af8195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56817c59e8544c1387cf186d3b53fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:03Z,use_quota=True,user_id='901fd129305649efa6e016779e71256a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71437631-1e9b-45e5-9c38-25670eef54d1),volume_type_id=71437631-1e9b-45e5-9c38-25670eef54d1)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4525ca25-a2cb-436a-b248-43cce84f8204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4525ca25-a2cb-436a-b248-43cce84f8204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670cd1cd-228d-443f-b84b-50194f054673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670cd1cd-228d-443f-b84b-50194f054673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c37486-11c2-4c54-bc83-3c80a4af8195', 'volume_name': 'volume-d4c37486-11c2-4c54-bc83-3c80a4af8195', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18aa96-808d-4b36-8a5f-be72ded2a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18aa96-808d-4b36-8a5f-be72ded2a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e494413c-3ccf-494b-8053-fcc3d72aeea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:03 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Volume d4c37486-11c2-4c54-bc83-3c80a4af8195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c37486-11c2-4c54-bc83-3c80a4af8195', 'volume_size': 1} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1772375327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c37486-11c2-4c54-bc83-3c80a4af8195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56817c59e8544c1387cf186d3b53fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:03Z,use_quota=True,user_id='901fd129305649efa6e016779e71256a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71437631-1e9b-45e5-9c38-25670eef54d1),volume_type_id=71437631-1e9b-45e5-9c38-25670eef54d1)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Creating volume d4c37486-11c2-4c54-bc83-3c80a4af8195 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:03 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:03 devstack quobyte-client[83627]: System call of process 97407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:03 devstack quobyte-client[83627]: System call of process 97407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:03 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=109, name=volume-d4c37486-11c2-4c54-bc83-3c80a4af8195, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 1073741824" returned: 0 in 0.427s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195" returned: 0 in 0.144s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] <== create_volume: return (647ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e494413c-3ccf-494b-8053-fcc3d72aeea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c37486-11c2-4c54-bc83-3c80a4af8195', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88f6d12-c9b1-4fbc-a51d-2ed6591d584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:04 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Volume volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 (d4c37486-11c2-4c54-bc83-3c80a4af8195): created successfully Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88f6d12-c9b1-4fbc-a51d-2ed6591d584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Flow 'volume_create_manager' (1aaa9174-a233-4e2c-b2b0-9a8b6fba6209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-169da2ec-f55c-4a5e-bf6d-5146f2b45e00 tempest-VolumeTypesAccessTest-754558714 None] Created volume successfully. Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Acquiring lock "cinder-d4c37486-11c2-4c54-bc83-3c80a4af8195-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "cinder-d4c37486-11c2-4c54-bc83-3c80a4af8195-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Acquiring lock "cinder-quobyte-d4c37486-11c2-4c54-bc83-3c80a4af8195" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "cinder-quobyte-d4c37486-11c2-4c54-bc83-3c80a4af8195" acquired by "delete_volume" :: waited 0.026s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ca740-5e73-47ea-9b9f-08efceb1e11c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195" returned: 0 in 0.474s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d4c37486-11c2-4c54-bc83-3c80a4af8195" returned: 0 in 0.139s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "cinder-quobyte-d4c37486-11c2-4c54-bc83-3c80a4af8195" released by "delete_volume" :: held 0.829s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:06 devstack cinder-volume[83624]: WARNING cinder.quota [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1094817793 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1094817793, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:53:06 devstack cinder-volume[83624]: WARNING cinder.quota [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1094817793 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1094817793, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:53:06 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Created reservations ['0a900322-bd93-4e75-8497-b20648f8dc05', 'ce56b4de-3283-4b31-910a-2c7f454f5a1f', '81baecca-f81f-479c-9b45-f1492ecc0e74', 'd3ab60f7-d603-4732-8667-c6aba0293406'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.127s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Deleted volume successfully. Sep 26 17:53:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1818a841-d6c3-4a2f-859b-048d08c0f762 tempest-VolumeTypesAccessTest-754558714 None] Lock "cinder-d4c37486-11c2-4c54-bc83-3c80a4af8195-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.132s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Flow 'volume_create_manager' (a910440d-90b7-4839-a8aa-359b4f19be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb4611-aa4b-43e7-a438-cd37ddc421b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb4611-aa4b-43e7-a438-cd37ddc421b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1722058072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd5a19c-c8c1-412e-9c3e-9539f789c945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7966defc93b47348476071d8b841c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:11Z,use_quota=True,user_id='f791e90dc19d4aeda5e3fcbb6fb9ad55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c9f908-fd71-4c13-8d3e-e7e7939f3227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c9f908-fd71-4c13-8d3e-e7e7939f3227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cf473-1802-4cae-a915-eec6c1903544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cf473-1802-4cae-a915-eec6c1903544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd5a19c-c8c1-412e-9c3e-9539f789c945', 'volume_name': 'volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279ae2db-d2fb-4414-b95f-32c4bfdb129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279ae2db-d2fb-4414-b95f-32c4bfdb129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685e5319-5ab5-4e9b-b177-35c770ffbfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:11 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Volume bfd5a19c-c8c1-412e-9c3e-9539f789c945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945', 'volume_size': 1} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1722058072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd5a19c-c8c1-412e-9c3e-9539f789c945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7966defc93b47348476071d8b841c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:11Z,use_quota=True,user_id='f791e90dc19d4aeda5e3fcbb6fb9ad55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Creating volume bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:11 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:11 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=110, name=volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 1073741824" returned: 0 in 0.366s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] <== create_volume: return (563ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.578s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685e5319-5ab5-4e9b-b177-35c770ffbfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12d6212-553f-484c-9cb8-f30ba69403fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:11 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Volume volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 (bfd5a19c-c8c1-412e-9c3e-9539f789c945): created successfully Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12d6212-553f-484c-9cb8-f30ba69403fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:11 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Flow 'volume_create_manager' (a910440d-90b7-4839-a8aa-359b4f19be84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cb787d18-eb05-4216-aaf8-58ab4e9cda8b tempest-SnapshotMetadataTestJSON-1160105505 None] Created volume successfully. Sep 26 17:53:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Creating offline snapshot e2a80379-95d0-473c-97a8-0d12ca01e058 of volume bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946f92e-fdb7-4078-9640-42657fcb0ec6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945" returned: 0 in 0.463s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:13 devstack quobyte-client[83627]: System call of process 97426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:13 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=111, name=volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 1G" returned: 0 in 0.288s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:14 devstack quobyte-client[83627]: System call of process 97429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "qemu-img rebase -u -b volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.161s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.108s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.info" returned: 0 in 0.121s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.info" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4704a1f1-8eae-42bb-8ff7-a76d934b097f tempest-SnapshotMetadataTestJSON-1160105505 None] Create snapshot completed successfully Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "cinder-e2a80379-95d0-473c-97a8-0d12ca01e058-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-e2a80379-95d0-473c-97a8-0d12ca01e058-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "cinder-quobyte-e2a80379-95d0-473c-97a8-0d12ca01e058" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-e2a80379-95d0-473c-97a8-0d12ca01e058" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Deleting offline snapshot e2a80379-95d0-473c-97a8-0d12ca01e058 of volume bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] snapshot_file for this snap is: volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa6579d-0820-4958-ba4a-36c76be7e54e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:17 devstack quobyte-client[83627]: System call of process 97438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.435s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4196e-6cdd-4c10-bcb9-14cbce335f1f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945" returned: 0 in 0.469s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:18 devstack quobyte-client[83627]: System call of process 97444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.257s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945.e2a80379-95d0-473c-97a8-0d12ca01e058" returned: 0 in 0.196s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-e2a80379-95d0-473c-97a8-0d12ca01e058" released by "_delete_snapshot" :: held 1.652s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" released by "delete_snapshot" :: held 1.682s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:19 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Created reservations ['23082f4a-021e-4d62-8708-62b3fa5c3e5e', 'ac95ed34-7917-4adc-883e-5d0976871837', '56661356-69f0-4cda-a36a-e8f9b893f758', 'fa8e2dd0-9c83-4bdc-8d70-3d14e48f934e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:19 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Delete snapshot completed successfully. Sep 26 17:53:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-5822c4ca-52de-4e3f-94f8-01e1a4f9b05d tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-e2a80379-95d0-473c-97a8-0d12ca01e058-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "cinder-bfd5a19c-c8c1-412e-9c3e-9539f789c945-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-bfd5a19c-c8c1-412e-9c3e-9539f789c945-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c7d09f-fb1d-4c7c-808a-dcc2336053b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945" returned: 0 in 0.454s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-bfd5a19c-c8c1-412e-9c3e-9539f789c945" returned: 0 in 0.123s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-quobyte-bfd5a19c-c8c1-412e-9c3e-9539f789c945" released by "delete_volume" :: held 0.770s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Created reservations ['e69039a5-83b1-4c83-b73d-034f7ea3fcb5', '8a66044d-20e6-4d2b-aba9-0879324024e0', '4c480413-8b62-464b-95e1-dacbd5e9d023', '3962c951-98e5-44b0-aa53-7bf06b57b21d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.096s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:21 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Deleted volume successfully. Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e354e226-fbb2-4c86-80a5-45a82882df66 tempest-SnapshotMetadataTestJSON-1160105505 None] Lock "cinder-bfd5a19c-c8c1-412e-9c3e-9539f789c945-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (8459efe0-149b-44ab-85d1-3b77fa34aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ab0ee9-b32a-4b50-ba8f-5874f337f31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ab0ee9-b32a-4b50-ba8f-5874f337f31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1399821264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462cda1f-e951-49c3-b33d-917a42383f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:22Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b595fc-98b6-462c-83ef-2320df69e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b595fc-98b6-462c-83ef-2320df69e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c971a-0ea4-44d3-a90b-db4f757b3b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c971a-0ea4-44d3-a90b-db4f757b3b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462cda1f-e951-49c3-b33d-917a42383f50', 'volume_name': 'volume-462cda1f-e951-49c3-b33d-917a42383f50', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6328ba-b478-4542-8fac-56f83335967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6328ba-b478-4542-8fac-56f83335967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb3681-52b7-47e4-a9c5-c6b83eed064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:22 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Volume 462cda1f-e951-49c3-b33d-917a42383f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462cda1f-e951-49c3-b33d-917a42383f50', 'volume_size': 1} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1399821264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462cda1f-e951-49c3-b33d-917a42383f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:22Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Creating volume 462cda1f-e951-49c3-b33d-917a42383f50 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:22 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:22 devstack quobyte-client[83627]: System call of process 97454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:22 devstack quobyte-client[83627]: System call of process 97454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:22 devstack quobyte-client[83627]: System call of process 97454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:22 devstack quobyte-client[83627]: System call of process 97454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:22 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=113, name=volume-462cda1f-e951-49c3-b33d-917a42383f50, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50 1073741824" returned: 0 in 0.353s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.548s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb3681-52b7-47e4-a9c5-c6b83eed064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462cda1f-e951-49c3-b33d-917a42383f50', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56306114-ab00-4acc-88d8-6f433883c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:23 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Volume volume-462cda1f-e951-49c3-b33d-917a42383f50 (462cda1f-e951-49c3-b33d-917a42383f50): created successfully Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56306114-ab00-4acc-88d8-6f433883c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (8459efe0-149b-44ab-85d1-3b77fa34aef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8701a85c-2157-47ef-a51f-16a3fb2b0aef tempest-VolumesListAdminTestJSON-1261341911 None] Created volume successfully. Sep 26 17:53:25 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (e62d46e6-873d-4105-9e42-3836b18c1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddb9132-ad0e-4503-ad54-4c9d9cb5202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddb9132-ad0e-4503-ad54-4c9d9cb5202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977121988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0577e4b2-66dd-4396-9501-a0cc792255d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:25Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62842aaa-f323-4a57-b2fd-4f722d4ddc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62842aaa-f323-4a57-b2fd-4f722d4ddc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e637dc7-3680-48c0-b49c-0e9b5892f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e637dc7-3680-48c0-b49c-0e9b5892f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0577e4b2-66dd-4396-9501-a0cc792255d4', 'volume_name': 'volume-0577e4b2-66dd-4396-9501-a0cc792255d4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dabb44d-c891-42ab-9ca2-5b4e8da8bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dabb44d-c891-42ab-9ca2-5b4e8da8bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3983f0-c595-431e-96c5-6a8977e62ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:25 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Volume 0577e4b2-66dd-4396-9501-a0cc792255d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0577e4b2-66dd-4396-9501-a0cc792255d4', 'volume_size': 1} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977121988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0577e4b2-66dd-4396-9501-a0cc792255d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:25Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Creating volume 0577e4b2-66dd-4396-9501-a0cc792255d4 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:25 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:25 devstack quobyte-client[83627]: System call of process 97490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:25 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=114, name=volume-0577e4b2-66dd-4396-9501-a0cc792255d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4 1073741824" returned: 0 in 0.352s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4" returned: 0 in 0.155s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] <== create_volume: return (588ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.598s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3983f0-c595-431e-96c5-6a8977e62ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0577e4b2-66dd-4396-9501-a0cc792255d4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c25d62-c38d-42fc-b5d1-bfef43748fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Volume volume-0577e4b2-66dd-4396-9501-a0cc792255d4 (0577e4b2-66dd-4396-9501-a0cc792255d4): created successfully Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c25d62-c38d-42fc-b5d1-bfef43748fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (e62d46e6-873d-4105-9e42-3836b18c1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:26 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ee7f4f6d-a934-4ffc-99a1-ea986cf5d312 tempest-VolumesListAdminTestJSON-1261341911 None] Created volume successfully. Sep 26 17:53:26 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Flow 'volume_create_manager' (2c90f87c-dc69-4996-a75d-e3c0c89c130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d22a8e2-e419-4634-a35d-497b80e79940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d22a8e2-e419-4634-a35d-497b80e79940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-181194905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ce7a2-3199-4354-bf97-9a4791ad8213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44bc00155f53498188f546961d67c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:26Z,use_quota=True,user_id='cae841cd408f4de0841140255882ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ce0862-18e7-4af7-aa74-9af10ccd4a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ce0862-18e7-4af7-aa74-9af10ccd4a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea757ea9-4428-41ae-913e-1a6a583ecb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea757ea9-4428-41ae-913e-1a6a583ecb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110ce7a2-3199-4354-bf97-9a4791ad8213', 'volume_name': 'volume-110ce7a2-3199-4354-bf97-9a4791ad8213', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36223770-1f05-4a0a-882a-c3d284c0ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36223770-1f05-4a0a-882a-c3d284c0ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369007b2-100d-4da7-9189-dfbc5882084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:26 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Volume 110ce7a2-3199-4354-bf97-9a4791ad8213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110ce7a2-3199-4354-bf97-9a4791ad8213', 'volume_size': 1} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-181194905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ce7a2-3199-4354-bf97-9a4791ad8213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44bc00155f53498188f546961d67c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:26Z,use_quota=True,user_id='cae841cd408f4de0841140255882ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Creating volume 110ce7a2-3199-4354-bf97-9a4791ad8213 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:26 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:26 devstack quobyte-client[83627]: System call of process 97494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:26 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=115, name=volume-110ce7a2-3199-4354-bf97-9a4791ad8213, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213 1073741824" returned: 0 in 0.332s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213" returned: 0 in 0.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369007b2-100d-4da7-9189-dfbc5882084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110ce7a2-3199-4354-bf97-9a4791ad8213', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a8993-446c-4591-aabf-f90eec6aa281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Volume volume-110ce7a2-3199-4354-bf97-9a4791ad8213 (110ce7a2-3199-4354-bf97-9a4791ad8213): created successfully Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a8993-446c-4591-aabf-f90eec6aa281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Flow 'volume_create_manager' (2c90f87c-dc69-4996-a75d-e3c0c89c130c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-49f5d2aa-75be-41d6-98c5-d6267195ffee tempest-VolumesMetadataTest-1831018375 None] Created volume successfully. Sep 26 17:53:27 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (d732866b-32bf-4bbb-b9e4-b3ecf38e50dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb828bc8-718a-4004-b282-9a6b1a629c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb828bc8-718a-4004-b282-9a6b1a629c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062005426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9282fdf4-af34-46ac-a999-1d44763f06d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:28Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea0397d-e520-4879-93bc-42355bda1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea0397d-e520-4879-93bc-42355bda1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db28e676-5e51-4790-acb1-62316306ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db28e676-5e51-4790-acb1-62316306ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9282fdf4-af34-46ac-a999-1d44763f06d3', 'volume_name': 'volume-9282fdf4-af34-46ac-a999-1d44763f06d3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4779e23e-e192-430c-b567-0c70e88ec00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4779e23e-e192-430c-b567-0c70e88ec00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0655ca5-33bb-495c-9932-78f4d88672c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:27 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Volume 9282fdf4-af34-46ac-a999-1d44763f06d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9282fdf4-af34-46ac-a999-1d44763f06d3', 'volume_size': 1} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062005426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9282fdf4-af34-46ac-a999-1d44763f06d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2d6c7181c948c59c924a56f435efb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:28Z,use_quota=True,user_id='1f52fa42340046a78640d147bfef5157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Creating volume 9282fdf4-af34-46ac-a999-1d44763f06d3 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:27 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:28 devstack quobyte-client[83627]: System call of process 97498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:28 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=116, name=volume-9282fdf4-af34-46ac-a999-1d44763f06d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3 1073741824" returned: 0 in 0.321s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3" returned: 0 in 0.086s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0655ca5-33bb-495c-9932-78f4d88672c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9282fdf4-af34-46ac-a999-1d44763f06d3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dff66ad-4eb9-4889-bbe8-79889e0bda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:28 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Volume volume-9282fdf4-af34-46ac-a999-1d44763f06d3 (9282fdf4-af34-46ac-a999-1d44763f06d3): created successfully Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dff66ad-4eb9-4889-bbe8-79889e0bda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Flow 'volume_create_manager' (d732866b-32bf-4bbb-b9e4-b3ecf38e50dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4dc762b3-2b74-4276-8247-ef8d07414672 tempest-VolumesListAdminTestJSON-1261341911 None] Created volume successfully. Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Acquiring lock "cinder-110ce7a2-3199-4354-bf97-9a4791ad8213-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "cinder-110ce7a2-3199-4354-bf97-9a4791ad8213-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Acquiring lock "cinder-quobyte-110ce7a2-3199-4354-bf97-9a4791ad8213" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "cinder-quobyte-110ce7a2-3199-4354-bf97-9a4791ad8213" acquired by "delete_volume" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d8a37-4667-47a2-aa56-7ac8c4389554]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213" returned: 0 in 0.501s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-110ce7a2-3199-4354-bf97-9a4791ad8213" returned: 0 in 0.125s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "cinder-quobyte-110ce7a2-3199-4354-bf97-9a4791ad8213" released by "delete_volume" :: held 1.007s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Flow 'volume_create_manager' (937f43a9-d72c-4b21-96bd-a7f30eee1382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9e3bf2-314e-46a3-8cc5-aab7f823a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9e3bf2-314e-46a3-8cc5-aab7f823a71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f275a46-bbc1-4450-9c15-af4d33d01329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfc7bc358bb48a9ac5fcd71980bbba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:31Z,use_quota=True,user_id='c37de985066f464aa4cc7e98c5a0c01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53ec03f-b691-4dd2-a048-9e766c506038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53ec03f-b691-4dd2-a048-9e766c506038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971711fb-59b8-45f4-ae76-eff113b68a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971711fb-59b8-45f4-ae76-eff113b68a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f275a46-bbc1-4450-9c15-af4d33d01329', 'volume_name': 'volume-6f275a46-bbc1-4450-9c15-af4d33d01329', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b35c6ee-dc61-4401-8369-f8f2ccc3e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b35c6ee-dc61-4401-8369-f8f2ccc3e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef45ec4-9e0e-4b15-a8d5-dd96ada51e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Volume 6f275a46-bbc1-4450-9c15-af4d33d01329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f275a46-bbc1-4450-9c15-af4d33d01329', 'volume_size': 1} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f275a46-bbc1-4450-9c15-af4d33d01329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfc7bc358bb48a9ac5fcd71980bbba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:31Z,use_quota=True,user_id='c37de985066f464aa4cc7e98c5a0c01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Creating volume 6f275a46-bbc1-4450-9c15-af4d33d01329 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:31 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:31 devstack quobyte-client[83627]: System call of process 97507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:31 devstack quobyte-client[83627]: System call of process 97507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:31 devstack quobyte-client[83627]: System call of process 97507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:31 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=117, name=volume-6f275a46-bbc1-4450-9c15-af4d33d01329, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329 1073741824" returned: 0 in 0.372s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Created reservations ['29cdc45c-b2f8-4887-87bd-ec7b7908f22e', '2636170b-1b85-440b-8f91-f4ed8660da7a', 'd2ca47ae-3d8f-4fec-a32d-058b25311383', '81b3a2d2-d88d-485e-b008-badb580a2e31'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329" returned: 0 in 0.365s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef45ec4-9e0e-4b15-a8d5-dd96ada51e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f275a46-bbc1-4450-9c15-af4d33d01329', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809a9625-6619-45df-9eff-5671ec4de234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Volume volume-6f275a46-bbc1-4450-9c15-af4d33d01329 (6f275a46-bbc1-4450-9c15-af4d33d01329): created successfully Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809a9625-6619-45df-9eff-5671ec4de234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Flow 'volume_create_manager' (937f43a9-d72c-4b21-96bd-a7f30eee1382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7b7ff5e2-35bb-4249-9aba-9f748c919446 tempest-VolumesListAdminTestJSON-397546816 None] Created volume successfully. Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.309s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Deleted volume successfully. Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d804230f-225a-4727-b61a-71c66066710c tempest-VolumesMetadataTest-1831018375 None] Lock "cinder-110ce7a2-3199-4354-bf97-9a4791ad8213-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Acquiring lock "cinder-6f275a46-bbc1-4450-9c15-af4d33d01329-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "cinder-6f275a46-bbc1-4450-9c15-af4d33d01329-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:33 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Acquiring lock "cinder-quobyte-6f275a46-bbc1-4450-9c15-af4d33d01329" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "cinder-quobyte-6f275a46-bbc1-4450-9c15-af4d33d01329" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-9282fdf4-af34-46ac-a999-1d44763f06d3-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9b869-785e-449c-8a56-3e2cc8edaa4f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-9282fdf4-af34-46ac-a999-1d44763f06d3-delete_volume" acquired by "delete_volume" :: waited 0.266s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:33 devstack quobyte-client[83627]: System call of process 97512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:33 devstack quobyte-client[83627]: System call of process 97512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:33 devstack quobyte-client[83627]: System call of process 97512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:33 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-quobyte-9282fdf4-af34-46ac-a999-1d44763f06d3" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-9282fdf4-af34-46ac-a999-1d44763f06d3" acquired by "delete_volume" :: waited 0.032s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329" returned: 0 in 0.721s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4025e243-ecf0-4fc3-bd68-3581a36a5107]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-6f275a46-bbc1-4450-9c15-af4d33d01329" returned: 0 in 0.375s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "cinder-quobyte-6f275a46-bbc1-4450-9c15-af4d33d01329" released by "delete_volume" :: held 1.214s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Created reservations ['a27b38a5-f302-45f9-a6b1-194214749081', 'f25faee9-4d96-4db3-870b-525093988923', '599517c6-ec79-45e1-a425-3bf2f0e3875d', '7bedbf10-20f0-433f-8a31-bad2668ccca4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3" returned: 0 in 0.696s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-9282fdf4-af34-46ac-a999-1d44763f06d3" returned: 0 in 0.299s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-9282fdf4-af34-46ac-a999-1d44763f06d3" released by "delete_volume" :: held 1.349s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.428s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:35 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Deleted volume successfully. Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cd827777-bb75-4142-a53c-a46e8247375d tempest-VolumesListAdminTestJSON-397546816 None] Lock "cinder-6f275a46-bbc1-4450-9c15-af4d33d01329-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Created reservations ['04a32841-e512-4416-a344-c3393c6c7fb7', '998c81ed-0f2b-40a2-b42f-f3b84ff1aa1b', 'cbb33ac9-da2c-4a47-820a-f89b29dd1019', '50428eec-0814-40c8-9190-3d29404ed604'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.156s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:35 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Deleted volume successfully. Sep 26 17:53:36 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8ebc46a8-2e5c-41ac-84c5-307946db37ce tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-9282fdf4-af34-46ac-a999-1d44763f06d3-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-0577e4b2-66dd-4396-9501-a0cc792255d4-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-0577e4b2-66dd-4396-9501-a0cc792255d4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:37 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-quobyte-0577e4b2-66dd-4396-9501-a0cc792255d4" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-0577e4b2-66dd-4396-9501-a0cc792255d4" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a066713d-4c6e-4bdd-9670-5e358454bbf8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:37 devstack quobyte-client[83627]: System call of process 97522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:37 devstack quobyte-client[83627]: System call of process 97522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4" returned: 0 in 0.446s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-0577e4b2-66dd-4396-9501-a0cc792255d4" returned: 0 in 0.122s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-0577e4b2-66dd-4396-9501-a0cc792255d4" released by "delete_volume" :: held 0.758s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Created reservations ['e84a5b17-ae3b-447b-8f81-5b71da4efa09', '284521f3-98e2-4e1a-b935-525b8ebe09cf', 'e3327317-045e-4219-942a-ca2a6adb183d', '7560f25e-7758-45a4-b01c-9ed46852cf49'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Deleted volume successfully. Sep 26 17:53:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9ccb3b07-75a5-4c2a-80d2-e627ab41bcde tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-0577e4b2-66dd-4396-9501-a0cc792255d4-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-462cda1f-e951-49c3-b33d-917a42383f50-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-462cda1f-e951-49c3-b33d-917a42383f50-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:39 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "cinder-quobyte-462cda1f-e951-49c3-b33d-917a42383f50" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-462cda1f-e951-49c3-b33d-917a42383f50" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d44cb24-25f8-44d8-94a8-eb038cebd166]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50" returned: 0 in 0.465s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-462cda1f-e951-49c3-b33d-917a42383f50" returned: 0 in 0.125s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-quobyte-462cda1f-e951-49c3-b33d-917a42383f50" released by "delete_volume" :: held 0.771s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Created reservations ['4bac7e25-3c11-478c-8157-d1b5f09b505d', '4c16954b-d567-40ae-89a1-53c8ed9800f2', 'f993e344-92b2-46ad-bd56-4ec319c74f1d', '976e6b4a-12ad-41f9-b7a5-08a1114e2d0b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.122s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:41 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Deleted volume successfully. Sep 26 17:53:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a2c91e14-f13b-42eb-9a60-44348425a03a tempest-VolumesListAdminTestJSON-1261341911 None] Lock "cinder-462cda1f-e951-49c3-b33d-917a42383f50-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Flow 'volume_create_manager' (83361ce9-22ab-4f82-86e8-54abc2d72b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d1d041-3c48-4c7e-b85d-94cd12b91456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d1d041-3c48-4c7e-b85d-94cd12b91456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1941248993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742e9c00-e9d1-4e9e-8d3c-247838e64768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d25d7b2d02442d98ea1f4665fc06c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:48Z,use_quota=True,user_id='24dbc6eb43c24ae7b8207660c7840d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ba4ebe-b846-4ab1-ab22-6ae8800a2d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ba4ebe-b846-4ab1-ab22-6ae8800a2d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5cde05-3b28-43d0-b3a9-604ad9b7f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5cde05-3b28-43d0-b3a9-604ad9b7f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742e9c00-e9d1-4e9e-8d3c-247838e64768', 'volume_name': 'volume-742e9c00-e9d1-4e9e-8d3c-247838e64768', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03766e2b-d5bf-4490-8504-1ec0a01e82c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03766e2b-d5bf-4490-8504-1ec0a01e82c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f6b2d1-d101-4e35-92e3-e393d7986b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:47 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Volume 742e9c00-e9d1-4e9e-8d3c-247838e64768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742e9c00-e9d1-4e9e-8d3c-247838e64768', 'volume_size': 1} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1941248993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742e9c00-e9d1-4e9e-8d3c-247838e64768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d25d7b2d02442d98ea1f4665fc06c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:48Z,use_quota=True,user_id='24dbc6eb43c24ae7b8207660c7840d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Creating volume 742e9c00-e9d1-4e9e-8d3c-247838e64768 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:47 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:48 devstack quobyte-client[83627]: System call of process 97535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:48 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=118, name=volume-742e9c00-e9d1-4e9e-8d3c-247838e64768, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 1073741824" returned: 0 in 0.406s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768" returned: 0 in 0.132s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f6b2d1-d101-4e35-92e3-e393d7986b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742e9c00-e9d1-4e9e-8d3c-247838e64768', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f139a2b1-2d99-4114-92c5-9559a5d950a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Volume volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 (742e9c00-e9d1-4e9e-8d3c-247838e64768): created successfully Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f139a2b1-2d99-4114-92c5-9559a5d950a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Flow 'volume_create_manager' (83361ce9-22ab-4f82-86e8-54abc2d72b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-399a8c97-c9ba-473d-84ce-fc38e563cf5e tempest-VolumesTransfersTest-418368169 None] Created volume successfully. Sep 26 17:53:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bfaee232-79c7-4465-a306-eb0652fb1750 tempest-VolumesTransfersTest-209673181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bfaee232-79c7-4465-a306-eb0652fb1750 tempest-VolumesTransfersTest-209673181 None] Transfer volume completed successfully. Sep 26 17:53:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Acquiring lock "cinder-742e9c00-e9d1-4e9e-8d3c-247838e64768-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "cinder-742e9c00-e9d1-4e9e-8d3c-247838e64768-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Acquiring lock "cinder-quobyte-742e9c00-e9d1-4e9e-8d3c-247838e64768" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "cinder-quobyte-742e9c00-e9d1-4e9e-8d3c-247838e64768" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:53 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4fa87-be72-4717-b4f3-598af42415b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768" returned: 0 in 0.469s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-742e9c00-e9d1-4e9e-8d3c-247838e64768" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "cinder-quobyte-742e9c00-e9d1-4e9e-8d3c-247838e64768" released by "delete_volume" :: held 0.765s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Created reservations ['4cf0993f-0e51-4e48-834a-4b436af44308', '003d77ad-9548-4cdf-9ced-58a6bb52ebff', '7b85d7eb-e968-4fe7-bcde-104a6aa96315', '08a41ea6-14f2-495c-8f87-4a20fae44fc0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:53:55 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Deleted volume successfully. Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57522fd1-8e57-44db-a9ac-d96a35088272 tempest-VolumesTransfersTest-336974919 None] Lock "cinder-742e9c00-e9d1-4e9e-8d3c-247838e64768-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Flow 'volume_create_manager' (49e6e816-12be-4a39-a53e-a919784c652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0693cd4-d8de-4f32-a8de-6ab95e01b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0693cd4-d8de-4f32-a8de-6ab95e01b557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-449254374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20e2e09-d26a-433b-a084-969e3b8d1166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d25d7b2d02442d98ea1f4665fc06c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:56Z,use_quota=True,user_id='24dbc6eb43c24ae7b8207660c7840d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ec17a8-ba67-49a1-aa82-826aae57d277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ec17a8-ba67-49a1-aa82-826aae57d277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53d2267-38de-4b5d-bd38-cc8e74a507e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53d2267-38de-4b5d-bd38-cc8e74a507e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20e2e09-d26a-433b-a084-969e3b8d1166', 'volume_name': 'volume-b20e2e09-d26a-433b-a084-969e3b8d1166', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d87d6b9-7b3d-4a94-8eaa-318e163dee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d87d6b9-7b3d-4a94-8eaa-318e163dee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c0dc30-aae6-49ba-a846-6dca13851971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Volume b20e2e09-d26a-433b-a084-969e3b8d1166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20e2e09-d26a-433b-a084-969e3b8d1166', 'volume_size': 1} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-449254374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20e2e09-d26a-433b-a084-969e3b8d1166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d25d7b2d02442d98ea1f4665fc06c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:53:56Z,use_quota=True,user_id='24dbc6eb43c24ae7b8207660c7840d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Creating volume b20e2e09-d26a-433b-a084-969e3b8d1166 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:53:56 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:56 devstack quobyte-client[83627]: System call of process 97545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:56 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=119, name=volume-b20e2e09-d26a-433b-a084-969e3b8d1166, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166 1073741824" returned: 0 in 0.378s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] <== create_volume: return (554ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c0dc30-aae6-49ba-a846-6dca13851971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20e2e09-d26a-433b-a084-969e3b8d1166', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b060067-0512-419e-b60b-c0804d61334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:53:56 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Volume volume-b20e2e09-d26a-433b-a084-969e3b8d1166 (b20e2e09-d26a-433b-a084-969e3b8d1166): created successfully Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b060067-0512-419e-b60b-c0804d61334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:53:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Flow 'volume_create_manager' (49e6e816-12be-4a39-a53e-a919784c652e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:53:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7f08f74c-d5fa-428c-875f-bc51641fb117 tempest-VolumesTransfersTest-418368169 None] Created volume successfully. Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Acquiring lock "cinder-b20e2e09-d26a-433b-a084-969e3b8d1166-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "cinder-b20e2e09-d26a-433b-a084-969e3b8d1166-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Acquiring lock "cinder-quobyte-b20e2e09-d26a-433b-a084-969e3b8d1166" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "cinder-quobyte-b20e2e09-d26a-433b-a084-969e3b8d1166" acquired by "delete_volume" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b8077f-684b-47a9-8ffe-ff4cbeccba88]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:53:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:59 devstack quobyte-client[83627]: System call of process 97549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166" returned: 0 in 0.604s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b20e2e09-d26a-433b-a084-969e3b8d1166" returned: 0 in 0.144s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "cinder-quobyte-b20e2e09-d26a-433b-a084-969e3b8d1166" released by "delete_volume" :: held 0.988s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Created reservations ['dfcd4433-51f4-4ea5-87cf-368fb84c6b76', 'fafb9234-f36f-4ba9-894b-951fa93cd08a', 'c4d159e8-0891-4fee-864d-8fac793c26dc', '2495281a-948b-4e2e-a079-4fde51147bdf'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:53:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.222s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:54:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Deleted volume successfully. Sep 26 17:54:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-cc320613-ea3d-40e8-9624-301fed7f7c7b tempest-VolumesTransfersTest-336974919 None] Lock "cinder-b20e2e09-d26a-433b-a084-969e3b8d1166-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:54:05 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=98,cinder:SELECT=62,cinder:INSERT=30,cinder:DELETE=10 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:54:05 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=59,cinder:UPDATE=95,cinder:DELETE=9,cinder:INSERT=10 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:54:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:05 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (cecdb83a-687a-4efe-9e62-3a6eea99a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:05 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8aa9467-a7b5-4d04-8ed0-8fd241319191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8aa9467-a7b5-4d04-8ed0-8fd241319191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2092949648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b0e43b-c6fb-45c0-87b5-bba869c23b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:06Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a037ae3d-7bab-404d-b714-89c64e87b42b),volume_type_id=a037ae3d-7bab-404d-b714-89c64e87b42b)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb044d57-ae25-43b8-a238-85e67db1ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb044d57-ae25-43b8-a238-85e67db1ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203d8e6-73bf-4c1d-8eeb-cfe01fbfa8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203d8e6-73bf-4c1d-8eeb-cfe01fbfa8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b0e43b-c6fb-45c0-87b5-bba869c23b38', 'volume_name': 'volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4716a0b6-a4f6-4347-8872-d66a49724ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4716a0b6-a4f6-4347-8872-d66a49724ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4dbfa8-0751-41ff-a00a-69214f4978e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume 69b0e43b-c6fb-45c0-87b5-bba869c23b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38', 'volume_size': 1} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2092949648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b0e43b-c6fb-45c0-87b5-bba869c23b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:06Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a037ae3d-7bab-404d-b714-89c64e87b42b),volume_type_id=a037ae3d-7bab-404d-b714-89c64e87b42b)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Creating volume 69b0e43b-c6fb-45c0-87b5-bba869c23b38 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:06 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:06 devstack quobyte-client[83627]: System call of process 97565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:06 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=120, name=volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (f191122e-a33c-4f1d-997c-6a8c080aa162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082c5c38-260d-4218-92f1-7884c8cf6b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 1073741824" returned: 0 in 0.871s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082c5c38-260d-4218-92f1-7884c8cf6b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784070481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a962bad-2eae-4ead-bc06-e0df8e879252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:06Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9042e27-e5d1-44fd-afbf-d2c940530fd9),volume_type_id=e9042e27-e5d1-44fd-afbf-d2c940530fd9)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc5cdc0-5268-43c7-b814-2cdec370f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc5cdc0-5268-43c7-b814-2cdec370f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996cd534-5c0b-4b24-8a32-af75347d9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996cd534-5c0b-4b24-8a32-af75347d9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a962bad-2eae-4ead-bc06-e0df8e879252', 'volume_name': 'volume-2a962bad-2eae-4ead-bc06-e0df8e879252', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba87c35-c220-43d0-bc63-0466594fa230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba87c35-c220-43d0-bc63-0466594fa230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d99449-4104-4a31-be8b-2152afc237ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:07 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume 2a962bad-2eae-4ead-bc06-e0df8e879252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a962bad-2eae-4ead-bc06-e0df8e879252', 'volume_size': 1} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38" returned: 0 in 0.372s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] <== create_volume: return (1267ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-784070481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a962bad-2eae-4ead-bc06-e0df8e879252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:06Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9042e27-e5d1-44fd-afbf-d2c940530fd9),volume_type_id=e9042e27-e5d1-44fd-afbf-d2c940530fd9)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Creating volume 2a962bad-2eae-4ead-bc06-e0df8e879252 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:07 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:07 devstack quobyte-client[83627]: System call of process 97569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:07 devstack quobyte-client[83627]: System call of process 97569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:07 devstack quobyte-client[83627]: System call of process 97569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:07 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=121, name=volume-2a962bad-2eae-4ead-bc06-e0df8e879252, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4dbfa8-0751-41ff-a00a-69214f4978e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c595a88b-a1be-4c04-8f9c-b22e544bd809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:08 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 (69b0e43b-c6fb-45c0-87b5-bba869c23b38): created successfully Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c595a88b-a1be-4c04-8f9c-b22e544bd809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (cecdb83a-687a-4efe-9e62-3a6eea99a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 1073741824" returned: 0 in 0.611s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (b79b1f23-b095-4431-a356-42bfbbcf09d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f741b65-336d-4fe5-86d0-78f6e8682d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b86306cb-5073-48d5-a1d0-20da510ff575 tempest-TestInstancesWithCinderVolumes-1373039529 None] Created volume successfully. Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252" returned: 0 in 0.537s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] <== create_volume: return (1185ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f741b65-336d-4fe5-86d0-78f6e8682d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-761108543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a673943a-668d-4f66-95dd-dda70e807572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:07Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8e7655-45b1-4cb5-8b93-8a5b6669965a),volume_type_id=0c8e7655-45b1-4cb5-8b93-8a5b6669965a)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b2bf3b-26a8-4cb2-861e-bc21302e90e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b2bf3b-26a8-4cb2-861e-bc21302e90e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f05813-56d3-4f8f-9d83-0f49bf8bbff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d99449-4104-4a31-be8b-2152afc237ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a962bad-2eae-4ead-bc06-e0df8e879252', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e048904d-5ac3-43a0-a91f-d9fbfae81468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:08 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume volume-2a962bad-2eae-4ead-bc06-e0df8e879252 (2a962bad-2eae-4ead-bc06-e0df8e879252): created successfully Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e048904d-5ac3-43a0-a91f-d9fbfae81468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (f191122e-a33c-4f1d-997c-6a8c080aa162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-dab4f0f8-d9b3-413c-af8a-c72061742664 tempest-TestInstancesWithCinderVolumes-1373039529 None] Created volume successfully. Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f05813-56d3-4f8f-9d83-0f49bf8bbff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a673943a-668d-4f66-95dd-dda70e807572', 'volume_name': 'volume-a673943a-668d-4f66-95dd-dda70e807572', 'volume_size': 1, 'image_id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1087450689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cd9caef84884c9a966409f5d31bd801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'created_at': datetime.datetime(2025, 9, 26, 15, 54, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 54, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defcb3c9-2477-46a6-8c3a-318005bff386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defcb3c9-2477-46a6-8c3a-318005bff386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3a4bf1-3b51-4ff1-b011-5bf6bd68a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:09 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume a673943a-668d-4f66-95dd-dda70e807572: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a673943a-668d-4f66-95dd-dda70e807572', 'volume_size': 1, 'image_id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1087450689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cd9caef84884c9a966409f5d31bd801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'created_at': datetime.datetime(2025, 9, 26, 15, 54, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 54, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c/file', 'properties': {}}, 'image_service': } Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Cloning a673943a-668d-4f66-95dd-dda70e807572 from image 2bc2b4a1-5393-4923-9acd-a36dacb1337c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:09 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Flow 'volume_create_manager' (60704cff-f888-4ae8-b041-99c985355c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c720d-916a-4899-a3b8-619c7b1ddc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c720d-916a-4899-a3b8-619c7b1ddc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1536321411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6df9fc3-347d-4035-83fa-a52671133fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f236823bccf84875a161a2ee7dd5b407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:09Z,use_quota=True,user_id='fe1d70b5cf044b75a5670cd7c84992f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aae153-4652-4ad5-85b8-61923fd28db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aae153-4652-4ad5-85b8-61923fd28db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ed22e0-530f-443c-96c9-7c0b54965776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ed22e0-530f-443c-96c9-7c0b54965776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6df9fc3-347d-4035-83fa-a52671133fb9', 'volume_name': 'volume-d6df9fc3-347d-4035-83fa-a52671133fb9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d15453-3fcb-4f2a-95b6-2a8b59e7922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d15453-3fcb-4f2a-95b6-2a8b59e7922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c29656-26f4-4740-89e4-0f06597948f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Volume d6df9fc3-347d-4035-83fa-a52671133fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6df9fc3-347d-4035-83fa-a52671133fb9', 'volume_size': 1} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1536321411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6df9fc3-347d-4035-83fa-a52671133fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f236823bccf84875a161a2ee7dd5b407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:09Z,use_quota=True,user_id='fe1d70b5cf044b75a5670cd7c84992f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Creating volume d6df9fc3-347d-4035-83fa-a52671133fb9 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:10 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.623s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:54:10 devstack quobyte-client[83627]: System call of process 97575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:10 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=122, name=volume-d6df9fc3-347d-4035-83fa-a52671133fb9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9 1073741824" returned: 0 in 0.413s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] <== create_volume: return (570ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c29656-26f4-4740-89e4-0f06597948f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6df9fc3-347d-4035-83fa-a52671133fb9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a3521-8e37-4062-a2de-e81ed17aa056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Volume volume-d6df9fc3-347d-4035-83fa-a52671133fb9 (d6df9fc3-347d-4035-83fa-a52671133fb9): created successfully Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a3521-8e37-4062-a2de-e81ed17aa056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Flow 'volume_create_manager' (60704cff-f888-4ae8-b041-99c985355c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e914314f-0f86-42e6-a1b0-a7e9a94882ef tempest-VolumesTransfersV357Test-693262590 None] Created volume successfully. Sep 26 17:54:11 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD, size 20.69 MB, duration 2.66 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 17:54:11 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Image download 20.69 MB at 7.77 MB/s Sep 26 17:54:12 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66d6591-9cda-41a9-abfe-c01ab0fc71d3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:12 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e01b7354-c225-4dd3-9d43-04a01796adab tempest-VolumesTransfersV357Test-1600134519 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:12 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD Sep 26 17:54:12 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e01b7354-c225-4dd3-9d43-04a01796adab tempest-VolumesTransfersV357Test-1600134519 None] Transfer volume completed successfully. Sep 26 17:54:12 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "cinder-d6df9fc3-347d-4035-83fa-a52671133fb9-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-d6df9fc3-347d-4035-83fa-a52671133fb9-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:54:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "cinder-quobyte-d6df9fc3-347d-4035-83fa-a52671133fb9" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-quobyte-d6df9fc3-347d-4035-83fa-a52671133fb9" acquired by "delete_volume" :: waited 0.009s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2524578f-9be5-4097-91de-276b0e31e2d6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:14 devstack quobyte-client[83627]: System call of process 97581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9" returned: 0 in 0.686s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:14 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-d6df9fc3-347d-4035-83fa-a52671133fb9" returned: 0 in 0.169s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-quobyte-d6df9fc3-347d-4035-83fa-a52671133fb9" released by "delete_volume" :: held 1.060s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD" returned: 0 in 2.557s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Temporary image 2bc2b4a1-5393-4923-9acd-a36dacb1337c is fetched for user 821567a51c92440b916cf0c76c4be39a. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Created reservations ['767c5c3a-3963-4498-9775-709d969c43ec', '250c6a8b-2532-4e97-a6ff-b191dba84a76', '150312d4-1ae8-425e-aec1-579f159f9385', 'a2f16ef3-ba3d-4bfa-a504-430de9c598c0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a1cd2e-e759-46a9-84b5-520260be2d1e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:15 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD Sep 26 17:54:15 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:15 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:54:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Deleted volume successfully. Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a35d2fc-81b8-4f3d-b052-9f092d36c4cf tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-d6df9fc3-347d-4035-83fa-a52671133fb9-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:54:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Flow 'volume_create_manager' (459d9f25-6a3f-4a53-858f-9bd4ec40635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91526486-dca9-49a6-a9c0-ede529fd39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91526486-dca9-49a6-a9c0-ede529fd39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1203746612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b710dcb5-2bdc-4294-a8e3-0bc840a37de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f236823bccf84875a161a2ee7dd5b407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:16Z,use_quota=True,user_id='fe1d70b5cf044b75a5670cd7c84992f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3b9d84-8cde-4e25-94df-a32e90808045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3b9d84-8cde-4e25-94df-a32e90808045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036f658f-654e-4048-9773-3fcae918cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036f658f-654e-4048-9773-3fcae918cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b710dcb5-2bdc-4294-a8e3-0bc840a37de6', 'volume_name': 'volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3f39f-f1d5-4357-9911-37923c07cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3f39f-f1d5-4357-9911-37923c07cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd55c5d-1b30-40a1-96b9-0b2403a80605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:16 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Volume b710dcb5-2bdc-4294-a8e3-0bc840a37de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6', 'volume_size': 1} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1203746612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b710dcb5-2bdc-4294-a8e3-0bc840a37de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f236823bccf84875a161a2ee7dd5b407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:16Z,use_quota=True,user_id='fe1d70b5cf044b75a5670cd7c84992f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Creating volume b710dcb5-2bdc-4294-a8e3-0bc840a37de6 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:16 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:16 devstack quobyte-client[83627]: System call of process 97591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=123, name=volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 1073741824" returned: 0 in 0.392s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" returned: 0 in 0.118s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] <== create_volume: return (655ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd55c5d-1b30-40a1-96b9-0b2403a80605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0405eac-0a2d-4741-923a-ac2e592471c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:17 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Volume volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 (b710dcb5-2bdc-4294-a8e3-0bc840a37de6): created successfully Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0405eac-0a2d-4741-923a-ac2e592471c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Flow 'volume_create_manager' (459d9f25-6a3f-4a53-858f-9bd4ec40635e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-599b0d9d-9595-4de3-8a9a-d084bd417afc tempest-VolumesTransfersV357Test-693262590 None] Created volume successfully. Sep 26 17:54:17 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD" returned: 0 in 2.925s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-761108543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a673943a-668d-4f66-95dd-dda70e807572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd9caef84884c9a966409f5d31bd801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:07Z,use_quota=True,user_id='821567a51c92440b916cf0c76c4be39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8e7655-45b1-4cb5-8b93-8a5b6669965a),volume_type_id=0c8e7655-45b1-4cb5-8b93-8a5b6669965a)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Creating volume a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:17 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:18 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=124, name=volume-a673943a-668d-4f66-95dd-dda70e807572, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 1073741824" returned: 0 in 0.284s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 0.102s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] <== create_volume: return (474ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Attempting download of 2bc2b4a1-5393-4923-9acd-a36dacb1337c ((None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}])) to volume a673943a-668d-4f66-95dd-dda70e807572. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cafb2de-a22e-41be-8dda-e846e47d5209]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bc2b4a1-5393-4923-9acd-a36dacb1337c_mj_h5jpm {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "cinder-b710dcb5-2bdc-4294-a8e3-0bc840a37de6-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-b710dcb5-2bdc-4294-a8e3-0bc840a37de6-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:54:19 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "cinder-quobyte-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2bc2b4a1-5393-4923-9acd-a36dacb1337c_mj_h5jpm" returned: 0 in 0.575s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bc2b4a1-5393-4923-9acd-a36dacb1337c_mj_h5jpm {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-quobyte-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" acquired by "delete_volume" :: waited 0.194s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eac606-7009-4998-8e4f-478475c0587b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bc2b4a1-5393-4923-9acd-a36dacb1337c_mj_h5jpm" returned: 1 in 0.487s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2bc2b4a1-5393-4923-9acd-a36dacb1337c_mj_h5jpm' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c4dab-4e4f-4cda-897f-02b2dbbf632c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" returned: 0 in 0.538s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-quobyte-b710dcb5-2bdc-4294-a8e3-0bc840a37de6" released by "delete_volume" :: held 0.874s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] 2bc2b4a1-5393-4923-9acd-a36dacb1337c was qcow2, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 17:54:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:20 devstack quobyte-client[83627]: System call of process 97616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:20 devstack quobyte-client[83627]: System call of process 97616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:20 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=124, name=volume-a673943a-668d-4f66-95dd-dda70e807572, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Created reservations ['65d378dd-6fc7-4eb9-9d99-3285cc65a123', 'b38724c7-31d4-42d4-838b-fa4c4c66ad0e', 'f8d3fc0c-024d-4516-b11d-cfd6e0df5b9e', '02bb60b1-3985-4683-aaf1-98eac382a05b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.113s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:54:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Deleted volume successfully. Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bf46b08-a021-477a-8f5a-ddb41e62245e tempest-VolumesTransfersV357Test-1349763114 None] Lock "cinder-b710dcb5-2bdc-4294-a8e3-0bc840a37de6-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 1.112s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2bc2b4a1-5393-4923-9acd-a36dacb1337c_uz1gtpgmdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:54:21 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Converted 112.00 MB image at 100.39 MB/s Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 1G" returned: 0 in 0.140s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:21 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea2fa4-7dc7-456d-a2a0-4b0295b3613b]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 0.482s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 1 in 0.433s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:54:22 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Downloaded image 2bc2b4a1-5393-4923-9acd-a36dacb1337c ((None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}])) to volume a673943a-668d-4f66-95dd-dda70e807572 successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Temporary image 2bc2b4a1-5393-4923-9acd-a36dacb1337c for user 821567a51c92440b916cf0c76c4be39a is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Marking volume a673943a-668d-4f66-95dd-dda70e807572 as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Copying metadata from image 2bc2b4a1-5393-4923-9acd-a36dacb1337c to a673943a-668d-4f66-95dd-dda70e807572. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Creating volume glance metadata for volume a673943a-668d-4f66-95dd-dda70e807572 backed by image 2bc2b4a1-5393-4923-9acd-a36dacb1337c with: {'image_id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'image_name': 'tempest-scenario-img--1087450689', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3a4bf1-3b51-4ff1-b011-5bf6bd68a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a673943a-668d-4f66-95dd-dda70e807572', 'volume_size': 1, 'image_id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1087450689', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cd9caef84884c9a966409f5d31bd801', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2bc2b4a1-5393-4923-9acd-a36dacb1337c', 'created_at': datetime.datetime(2025, 9, 26, 15, 54, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 15, 54, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2bc2b4a1-5393-4923-9acd-a36dacb1337c/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1089e4-6ff0-43c6-a572-77f106d35ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:23 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume volume-a673943a-668d-4f66-95dd-dda70e807572 (a673943a-668d-4f66-95dd-dda70e807572): created successfully Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1089e4-6ff0-43c6-a572-77f106d35ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:23 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Flow 'volume_create_manager' (b79b1f23-b095-4431-a356-42bfbbcf09d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1867228b-57aa-4bd8-b140-9ce0d6b10456 tempest-TestInstancesWithCinderVolumes-1373039529 None] Created volume successfully. Sep 26 17:54:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:33 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[46452790-ec5f-47f6-a6d2-13f4879cd6de]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:54:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 0.964s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:35 devstack quobyte-client[83627]: System call of process 97679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:35 devstack quobyte-client[83627]: System call of process 97679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 1 in 0.857s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:54:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.030s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-a673943a-668d-4f66-95dd-dda70e807572', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a05bbc2d-9a42-4202-ae50-9499da2a5b10', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:54:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:35 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-42e011c9-74c1-41a5-acf7-e4203e770a0b req-202203e0-f07c-4129-820c-710008b66b52 tempest-TestInstancesWithCinderVolumes-1373039529 None] attachment_update completed successfully. Sep 26 17:54:41 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Flow 'volume_create_manager' (df41c56e-c8a9-427b-91ea-c0ed2437a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643774e2-0016-49a0-a8e2-83e3c1655eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643774e2-0016-49a0-a8e2-83e3c1655eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741490398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a76d97f-d731-43e5-887a-a84da643ace1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7ade6db66248989433a0db47e09c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:41Z,use_quota=True,user_id='635c35b67bd748b1876050264cee1da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f1b151-dbbb-45e9-a2fb-340f001a7ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f1b151-dbbb-45e9-a2fb-340f001a7ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced26938-a052-4bfc-90e8-3f7754d5a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced26938-a052-4bfc-90e8-3f7754d5a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a76d97f-d731-43e5-887a-a84da643ace1', 'volume_name': 'volume-5a76d97f-d731-43e5-887a-a84da643ace1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64490f1-51c2-4a11-9cab-3ebdfa7b0691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64490f1-51c2-4a11-9cab-3ebdfa7b0691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26b80a4-a5be-4bc6-9b91-fdc449a11e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Volume 5a76d97f-d731-43e5-887a-a84da643ace1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a76d97f-d731-43e5-887a-a84da643ace1', 'volume_size': 1} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741490398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a76d97f-d731-43e5-887a-a84da643ace1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c7ade6db66248989433a0db47e09c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:54:41Z,use_quota=True,user_id='635c35b67bd748b1876050264cee1da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Creating volume 5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:54:41 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:41 devstack quobyte-client[83627]: System call of process 97753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:54:41 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=125, name=volume-5a76d97f-d731-43e5-887a-a84da643ace1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 1073741824" returned: 0 in 0.323s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] <== create_volume: return (518ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.531s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26b80a4-a5be-4bc6-9b91-fdc449a11e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a76d97f-d731-43e5-887a-a84da643ace1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31461699-0b68-4e04-8b9c-92720346f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:54:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Volume volume-5a76d97f-d731-43e5-887a-a84da643ace1 (5a76d97f-d731-43e5-887a-a84da643ace1): created successfully Sep 26 17:54:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31461699-0b68-4e04-8b9c-92720346f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:54:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Flow 'volume_create_manager' (df41c56e-c8a9-427b-91ea-c0ed2437a601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:54:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-740e7eff-4fbe-4e7f-967d-1ca5af315fa0 tempest-VolumesActionsTest-1591645501 None] Created volume successfully. Sep 26 17:54:52 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=25,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=12 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:54:52 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:55:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:55:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.418s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:55:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:55:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" by "attach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:55:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" acquired by "attach_volume" :: waited 0.075s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:55:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Attaching volume 5a76d97f-d731-43e5-887a-a84da643ace1 to instance 4f97e9a2-eef7-467a-a314-bd3c34a6fed8 at mountpoint /dev/vdb on host None. Sep 26 17:55:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Attach volume completed successfully. Sep 26 17:55:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7519143f-d967-448b-8a90-6bda5a427ff8 tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" released by "attach_volume" :: held 0.369s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:55:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" by "detach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:55:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:55:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Detaching volume 5a76d97f-d731-43e5-887a-a84da643ace1 from instance 4f97e9a2-eef7-467a-a314-bd3c34a6fed8. Sep 26 17:55:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Detach volume completed successfully. Sep 26 17:55:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2f4443cf-115b-4bd8-a815-ff25aa6b2aef tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:55:27 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:55:27 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:55:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" by "attach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:55:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" acquired by "attach_volume" :: waited 0.020s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:55:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Attaching volume 5a76d97f-d731-43e5-887a-a84da643ace1 to instance deaf9ef3-187a-4462-9740-d574f42059e6 at mountpoint /dev/vdb on host None. Sep 26 17:55:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Attach volume completed successfully. Sep 26 17:55:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-63a435a3-cba1-405a-a74d-51aebfc7858d tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1" released by "attach_volume" :: held 0.152s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:55:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" by "detach_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:55:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:55:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Detaching volume 5a76d97f-d731-43e5-887a-a84da643ace1 from instance deaf9ef3-187a-4462-9740-d574f42059e6. Sep 26 17:55:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Detach volume completed successfully. Sep 26 17:55:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-dc4f0b2e-d879-4beb-94e8-618d95bf609a tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ff5ce-35ad-484a-bef2-2cd04699022d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:55:57 devstack quobyte-client[83627]: System call of process 98765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38" returned: 0 in 0.446s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.514s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:55:57 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dfa88cb-980a-4260-81b7-912a16fe5e49', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:55:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:55:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-8da3c5a7-b795-4e00-9921-4d794321a425 req-2ebb49a6-38a6-4329-aa5d-f369dd31fdaf tempest-TestInstancesWithCinderVolumes-1373039529 None] attachment_update completed successfully. Sep 26 17:56:04 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[78963c5c-85f0-4922-9f67-8264c4ccd609]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:04 devstack quobyte-client[83627]: System call of process 98784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.473s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da22c55-e00d-4bd9-909c-09b8e1f32ccb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:05 devstack quobyte-client[83627]: System call of process 98791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.586s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.1f508154-8bfd-4db4-9ed3-11825437b06f2dtyrfne.img {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:08 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:INSERT=2,cinder:SELECT=12,cinder:UPDATE=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:56:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.1f508154-8bfd-4db4-9ed3-11825437b06f2dtyrfne.img" returned: 0 in 4.706s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.432s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:56:10 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b245cb-da7e-4959-afc5-8d85c5567cf0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 1.016s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:56:11 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.1f508154-8bfd-4db4-9ed3-11825437b06f2dtyrfne.img {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:56:11 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Converted 1024.00 MB image at 215.64 MB/s Sep 26 17:56:11 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] 1f508154-8bfd-4db4-9ed3-11825437b06f was raw, no need to convert to raw {{(pid=83624) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 26 17:56:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=3 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:56:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:56:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.469s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:56:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Uploaded volume to glance image-id: 1f508154-8bfd-4db4-9ed3-11825437b06f. {{(pid=83624) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 26 17:56:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.322s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:56:39 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[43526236-7362-4f1e-941c-728147f0d0e8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:39 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-982b1580-732e-4919-bb60-061ba9c5a20f tempest-VolumesActionsTest-1591645501 None] Copy volume to image completed successfully. Sep 26 17:56:40 devstack quobyte-client[83627]: System call of process 98888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252" returned: 0 in 0.528s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-2a962bad-2eae-4ead-bc06-e0df8e879252', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4bc9a5f-63c5-4dad-bcf9-11a24a811d3b', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 17:56:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:56:40 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-e30f1275-f77c-4e73-af35-5731cd59a505 req-267486b6-3b40-4258-9055-709ee89c5641 tempest-TestInstancesWithCinderVolumes-1373039529 None] attachment_update completed successfully. Sep 26 17:56:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876509a-b23c-45af-82b3-0a6a4af8b7e6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.473s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc31d5-eda7-4e57-8c82-cc895e015acf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.472s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:42 devstack quobyte-client[83627]: System call of process 98903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img" returned: 0 in 4.838s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:46 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70d90d-f816-41bd-a0f3-e8311ad4bb16]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:47 devstack quobyte-client[83627]: System call of process 98915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:47 devstack quobyte-client[83627]: System call of process 98915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:47 devstack quobyte-client[83627]: System call of process 98915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:56:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.572s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:47 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:56:47 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Converted 1024.00 MB image at 210.61 MB/s Sep 26 17:56:47 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] 6050218d-746a-441f-bd76-208b62316270 was raw, converting to qcow2 {{(pid=83624) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 26 17:56:47 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e6872-a7a2-417f-8ca6-5d36950cef51]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img" returned: 0 in 0.387s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img" returned: 1 in 0.381s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img /opt/stack/data/cinder/conversion/vol_upload_ek9m71mt {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img /opt/stack/data/cinder/conversion/vol_upload_ek9m71mt" returned: 0 in 0.176s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Image conversion details: src /opt/stack/data/cinder/conversion/5a76d97f-d731-43e5-887a-a84da643ace1.temp_image.6050218d-746a-441f-bd76-208b62316270mo94eboc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ek9m71mt {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 17:56:48 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee3304-4fb4-4aff-9d07-2a517f61ac5b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ek9m71mt {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ek9m71mt" returned: 0 in 0.355s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.430s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:56:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Uploaded volume to glance image-id: 6050218d-746a-441f-bd76-208b62316270. {{(pid=83624) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 26 17:56:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-cc09182e-edad-4fd8-b578-2b70df1eea01 tempest-VolumesActionsTest-1591645501 None] Copy volume to image completed successfully. Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:56:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Acquiring lock "cinder-quobyte-5a76d97f-d731-43e5-887a-a84da643ace1" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "cinder-quobyte-5a76d97f-d731-43e5-887a-a84da643ace1" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67b681-6f8a-4901-a09c-de8acee03745]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:56:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.432s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5a76d97f-d731-43e5-887a-a84da643ace1" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "cinder-quobyte-5a76d97f-d731-43e5-887a-a84da643ace1" released by "delete_volume" :: held 0.702s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Created reservations ['cdf1fbc4-78b7-4f66-86f7-a50841ca6ee6', '8f5aa24f-7510-4aee-a4f1-8c3304a13ed1', '829dc002-a4c8-4f7a-b264-e24d61bb3a7d', 'c88e3c59-f14f-4706-9250-c6a994ebd54b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.092s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:56:53 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:56:53 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Deleted volume successfully. Sep 26 17:56:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ca54cb9c-5842-413e-a6cb-c1aa7718e6ee tempest-VolumesActionsTest-1591645501 None] Lock "cinder-5a76d97f-d731-43e5-887a-a84da643ace1-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Flow 'volume_create_manager' (f583d803-d673-4d57-8105-1bf5d4c0ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97f3dd3-6926-4a48-8bb9-a4e48109e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97f3dd3-6926-4a48-8bb9-a4e48109e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1722415626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5686aabf-6d05-408d-9aa4-b3ca44928fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62637ce6b37a49858984b809882e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:01Z,use_quota=True,user_id='525368badb3a4d4d9f109b260ac87b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031e69b0-2b34-4694-ab2d-6f840665a669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031e69b0-2b34-4694-ab2d-6f840665a669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3c2704-b266-4dc8-a4c0-0143bba19c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3c2704-b266-4dc8-a4c0-0143bba19c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5686aabf-6d05-408d-9aa4-b3ca44928fc3', 'volume_name': 'volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3', 'volume_size': 2}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f00de2-e01c-429f-a603-8d7f15e054fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f00de2-e01c-429f-a603-8d7f15e054fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d622f7-bb80-43b6-be03-1a390e5312b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:01 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Volume 5686aabf-6d05-408d-9aa4-b3ca44928fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3', 'volume_size': 2} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1722415626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5686aabf-6d05-408d-9aa4-b3ca44928fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62637ce6b37a49858984b809882e9801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:01Z,use_quota=True,user_id='525368badb3a4d4d9f109b260ac87b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Creating volume 5686aabf-6d05-408d-9aa4-b3ca44928fc3 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:57:01 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:57:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 2147483648 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:01 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=126, name=volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 2147483648" returned: 0 in 0.436s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] <== create_volume: return (623ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d622f7-bb80-43b6-be03-1a390e5312b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3', 'volume_size': 2}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea78702f-608d-4fe0-9018-51eecdc6dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:02 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Volume volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 (5686aabf-6d05-408d-9aa4-b3ca44928fc3): created successfully Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea78702f-608d-4fe0-9018-51eecdc6dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:02 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Flow 'volume_create_manager' (f583d803-d673-4d57-8105-1bf5d4c0ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-24dc4c79-0621-4c96-8ead-e0c5779cf64a tempest-VolumesCloneNegativeTest-2008842662 None] Created volume successfully. Sep 26 17:57:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Acquiring lock "cinder-5686aabf-6d05-408d-9aa4-b3ca44928fc3-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "cinder-5686aabf-6d05-408d-9aa4-b3ca44928fc3-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Acquiring lock "cinder-quobyte-5686aabf-6d05-408d-9aa4-b3ca44928fc3" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "cinder-quobyte-5686aabf-6d05-408d-9aa4-b3ca44928fc3" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9133a-364a-4360-b3fe-006063740a5c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:04 devstack quobyte-client[83627]: System call of process 98983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3" returned: 0 in 0.395s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5686aabf-6d05-408d-9aa4-b3ca44928fc3" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "cinder-quobyte-5686aabf-6d05-408d-9aa4-b3ca44928fc3" released by "delete_volume" :: held 0.685s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Created reservations ['cc07dd9a-6892-4d9e-a020-a54ce76b570e', 'b80b9084-f55e-4cc6-b332-0bf61174ca5f', '73005c09-37f5-445d-9aa2-3d3d595e9fa9', '6d602c23-355c-4381-84cf-769cd5bd675d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:57:05 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Deleted volume successfully. Sep 26 17:57:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0bbc29c7-59fb-4c53-a18b-7f1acee41123 tempest-VolumesCloneNegativeTest-2008842662 None] Lock "cinder-5686aabf-6d05-408d-9aa4-b3ca44928fc3-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Flow 'volume_create_manager' (e1c57763-6b8d-40be-8f1c-61f13ff1e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485bf18a-a2a2-4345-ac4a-aa846a17df18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485bf18a-a2a2-4345-ac4a-aa846a17df18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-429040275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d2e8e9-6163-469b-a426-7f32797aa9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be3f77e84bb4d78829b64a6df20052c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:09Z,use_quota=True,user_id='d37340c9592f467aa3fd4535b4c4fbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376dd5e3-5a08-41be-a23c-0658d10cc19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376dd5e3-5a08-41be-a23c-0658d10cc19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f79c888-0b0d-496f-b265-3a207d51c02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f79c888-0b0d-496f-b265-3a207d51c02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d2e8e9-6163-469b-a426-7f32797aa9ca', 'volume_name': 'volume-30d2e8e9-6163-469b-a426-7f32797aa9ca', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863cf8d4-77ff-4781-8fbb-87de2ec8bc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863cf8d4-77ff-4781-8fbb-87de2ec8bc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78a488a-190d-4295-8819-639b08016ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:08 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Volume 30d2e8e9-6163-469b-a426-7f32797aa9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d2e8e9-6163-469b-a426-7f32797aa9ca', 'volume_size': 1} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-429040275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d2e8e9-6163-469b-a426-7f32797aa9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be3f77e84bb4d78829b64a6df20052c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:09Z,use_quota=True,user_id='d37340c9592f467aa3fd4535b4c4fbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Creating volume 30d2e8e9-6163-469b-a426-7f32797aa9ca {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:57:08 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:57:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:09 devstack quobyte-client[83627]: System call of process 98989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:09 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=127, name=volume-30d2e8e9-6163-469b-a426-7f32797aa9ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca 1073741824" returned: 0 in 0.308s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca" returned: 0 in 0.086s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] <== create_volume: return (462ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.474s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78a488a-190d-4295-8819-639b08016ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d2e8e9-6163-469b-a426-7f32797aa9ca', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da0d5d-6543-4004-9317-b2e50574a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.330s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:57:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Volume volume-30d2e8e9-6163-469b-a426-7f32797aa9ca (30d2e8e9-6163-469b-a426-7f32797aa9ca): created successfully Sep 26 17:57:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da0d5d-6543-4004-9317-b2e50574a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Flow 'volume_create_manager' (e1c57763-6b8d-40be-8f1c-61f13ff1e155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:10 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6bd38f53-7bdb-46a8-8d2f-c1c4e5d9fc6e tempest-VolumesNegativeTest-1821350686 None] Created volume successfully. Sep 26 17:57:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-41645bb0-5f28-490b-932f-21853c404715 req-c4bf0647-114b-491a-af4b-060493e74b42 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-41645bb0-5f28-490b-932f-21853c404715 req-c4bf0647-114b-491a-af4b-060493e74b42 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:17 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-41645bb0-5f28-490b-932f-21853c404715 req-c4bf0647-114b-491a-af4b-060493e74b42 tempest-TestInstancesWithCinderVolumes-1373039529 None] Terminate volume connection completed successfully. Sep 26 17:57:17 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-41645bb0-5f28-490b-932f-21853c404715 req-c4bf0647-114b-491a-af4b-060493e74b42 tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleting attachment 1dfa88cb-980a-4260-81b7-912a16fe5e49. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:57:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-69b0e43b-c6fb-45c0-87b5-bba869c23b38-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:19 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:57:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-69b0e43b-c6fb-45c0-87b5-bba869c23b38-delete_volume" acquired by "delete_volume" :: waited 0.266s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-quobyte-69b0e43b-c6fb-45c0-87b5-bba869c23b38" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-69b0e43b-c6fb-45c0-87b5-bba869c23b38" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:20 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4475db-899b-474b-970b-5063cc57c934]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:57:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:21 devstack quobyte-client[83627]: System call of process 99017 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:21 devstack quobyte-client[83627]: System call of process 99017 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38" returned: 0 in 0.765s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-69b0e43b-c6fb-45c0-87b5-bba869c23b38" returned: 0 in 0.130s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-69b0e43b-c6fb-45c0-87b5-bba869c23b38" released by "delete_volume" :: held 1.168s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:21 devstack cinder-volume[83624]: WARNING cinder.quota [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583404978-170458298 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583404978-170458298, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:57:21 devstack cinder-volume[83624]: WARNING cinder.quota [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583404978-170458298 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583404978-170458298, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:57:21 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Created reservations ['d3d015a5-de6e-4da0-b3c6-d3265abc2b8e', '53687f91-946c-4fc5-8e8e-59200001468c', '1b7067c4-f996-46f2-81e1-406e044cb55e', 'dee1684d-9480-4857-aa7f-9fc148553363'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.155s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:57:22 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleted volume successfully. Sep 26 17:57:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-fbc1b06a-4720-4453-8d4d-a255cf7bbb6d tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-69b0e43b-c6fb-45c0-87b5-bba869c23b38-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:31 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:57:32 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=4 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Acquiring lock "cinder-30d2e8e9-6163-469b-a426-7f32797aa9ca-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "cinder-30d2e8e9-6163-469b-a426-7f32797aa9ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Acquiring lock "cinder-quobyte-30d2e8e9-6163-469b-a426-7f32797aa9ca" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "cinder-quobyte-30d2e8e9-6163-469b-a426-7f32797aa9ca" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d13f0-2566-4384-a078-0d9f271fffcc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca" returned: 0 in 0.415s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-e56c4f1e-747b-4a34-9905-aabd1fff8441 req-f4028715-b05a-4d0b-b968-eea65ff9e9b4 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-30d2e8e9-6163-469b-a426-7f32797aa9ca" returned: 0 in 0.409s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-e56c4f1e-747b-4a34-9905-aabd1fff8441 req-f4028715-b05a-4d0b-b968-eea65ff9e9b4 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-e56c4f1e-747b-4a34-9905-aabd1fff8441 req-f4028715-b05a-4d0b-b968-eea65ff9e9b4 tempest-TestInstancesWithCinderVolumes-1373039529 None] Terminate volume connection completed successfully. Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-e56c4f1e-747b-4a34-9905-aabd1fff8441 req-f4028715-b05a-4d0b-b968-eea65ff9e9b4 tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleting attachment a4bc9a5f-63c5-4dad-bcf9-11a24a811d3b. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "cinder-quobyte-30d2e8e9-6163-469b-a426-7f32797aa9ca" released by "delete_volume" :: held 0.964s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Created reservations ['90f551ae-90ac-4d44-b875-bea91f5932c7', '8ebaa689-9239-4317-8b61-df7d26391327', '9a384744-2774-4ef7-8573-fde15004da1b', '730cb093-9568-4def-8e1f-e7269408a4e0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.088s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:50 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:57:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Deleted volume successfully. Sep 26 17:57:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-33dd60b5-3357-42e3-b981-806faa542a1f tempest-VolumesNegativeTest-1821350686 None] Lock "cinder-30d2e8e9-6163-469b-a426-7f32797aa9ca-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-2a962bad-2eae-4ead-bc06-e0df8e879252-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-2a962bad-2eae-4ead-bc06-e0df8e879252-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-quobyte-2a962bad-2eae-4ead-bc06-e0df8e879252" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-2a962bad-2eae-4ead-bc06-e0df8e879252" acquired by "delete_volume" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57bbde-b22a-438a-abef-1ec27442e8c2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:57:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252" returned: 0 in 0.562s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2a962bad-2eae-4ead-bc06-e0df8e879252" returned: 0 in 0.133s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-2a962bad-2eae-4ead-bc06-e0df8e879252" released by "delete_volume" :: held 0.916s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:53 devstack cinder-volume[83624]: WARNING cinder.quota [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1778457376-1916106849 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1778457376-1916106849, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:57:53 devstack cinder-volume[83624]: WARNING cinder.quota [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1778457376-1916106849 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1778457376-1916106849, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:57:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Created reservations ['70cbb381-6f22-4bd3-9ca4-3d23cf63e57a', 'cb8e840a-309d-48c3-bec0-a1ddd90a6d4f', '5bbb7bc9-e3ce-4490-88fc-b1cb8181ba79', 'ce44b915-b551-4eee-80f7-f3d6088b9bec'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.165s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:57:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleted volume successfully. Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-06225bfd-b974-48d4-86b0-e826f3115063 tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-2a962bad-2eae-4ead-bc06-e0df8e879252-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:57:54 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Flow 'volume_create_manager' (9340e3b1-2e83-487d-857b-33fba4b75c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb7e7ae-f35c-4a8f-aced-0f4c154b0682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb7e7ae-f35c-4a8f-aced-0f4c154b0682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-813076581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e5b75-2d88-4085-9576-f1d30dc4f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d0a2b2f63d4bd0b779940e4330ef70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:55Z,use_quota=True,user_id='991224c9a5bf4c8598f5d2d66247d13d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcce117-88b4-4cec-8fc0-933edcb75354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcce117-88b4-4cec-8fc0-933edcb75354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df14c3-73ca-4646-b422-c8631581d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df14c3-73ca-4646-b422-c8631581d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934e5b75-2d88-4085-9576-f1d30dc4f2a9', 'volume_name': 'volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8115f64d-4685-4a77-8b19-0b20608ac5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8115f64d-4685-4a77-8b19-0b20608ac5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afaeafb-9aec-46e9-8ec5-86aecf1f46d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:55 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9', 'volume_size': 1} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-813076581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e5b75-2d88-4085-9576-f1d30dc4f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d0a2b2f63d4bd0b779940e4330ef70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:57:55Z,use_quota=True,user_id='991224c9a5bf4c8598f5d2d66247d13d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Creating volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:57:55 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:55 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=128, name=volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 1073741824" returned: 0 in 0.554s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9" returned: 0 in 0.148s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:57:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:57:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afaeafb-9aec-46e9-8ec5-86aecf1f46d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852306a2-e02b-4ae4-a58d-b8b563455a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:57:56 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 (934e5b75-2d88-4085-9576-f1d30dc4f2a9): created successfully Sep 26 17:57:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852306a2-e02b-4ae4-a58d-b8b563455a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:57:56 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Flow 'volume_create_manager' (9340e3b1-2e83-487d-857b-33fba4b75c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:57:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c0c966c8-ea9b-4005-b515-19822fa2e651 tempest-VolumesSnapshotListTestJSON-227736118 None] Created volume successfully. Sep 26 17:57:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:57:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:57:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:57:57 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Creating offline snapshot bec481a8-c494-4b6c-8f2b-f4cec587f439 of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:57:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[becaece2-64b3-4df6-b403-ed0ee01f1b5f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:57:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:58 devstack quobyte-client[83627]: System call of process 99241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:58 devstack quobyte-client[83627]: System call of process 99241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9" returned: 0 in 1.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:58 devstack quobyte-client[83627]: System call of process 99259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:58 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=129, name=volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 1G" returned: 0 in 0.387s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:59 devstack quobyte-client[83627]: System call of process 99265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.248s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.241s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:57:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.info" returned: 0 in 0.140s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:58:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.info" returned: 0 in 0.110s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4033edf8-1892-47a8-ab68-330518096001 tempest-VolumesSnapshotListTestJSON-227736118 None] Create snapshot completed successfully Sep 26 17:58:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-2e8a88c8-b889-41c0-8cc5-7b4bd231b5dc req-0f20b54e-6543-4e0d-8161-448a6008b4cf tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Creating offline snapshot 95c04398-5ceb-40ab-927f-61614bb40a27 of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:58:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-2e8a88c8-b889-41c0-8cc5-7b4bd231b5dc req-0f20b54e-6543-4e0d-8161-448a6008b4cf tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:01 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-2e8a88c8-b889-41c0-8cc5-7b4bd231b5dc req-0f20b54e-6543-4e0d-8161-448a6008b4cf tempest-TestInstancesWithCinderVolumes-1373039529 None] Terminate volume connection completed successfully. Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-2e8a88c8-b889-41c0-8cc5-7b4bd231b5dc req-0f20b54e-6543-4e0d-8161-448a6008b4cf tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleting attachment a05bbc2d-9a42-4202-ae50-9499da2a5b10. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5bbb74-0efe-4d37-a812-acfd2dbddccf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.439s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:02 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=131, name=volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 1G" returned: 0 in 0.311s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:58:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:03 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:58:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.504s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-54353719-4453-4ecc-900a-97f7075ff011 tempest-VolumesSnapshotListTestJSON-227736118 None] Create snapshot completed successfully Sep 26 17:58:04 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Creating offline snapshot 95a66814-3a9e-48bc-b3a5-8a34adc202aa of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9549905-c5b1-46fd-94e5-2e905f7cb49d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:04 devstack quobyte-client[83627]: System call of process 99294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:04 devstack quobyte-client[83627]: System call of process 99294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.436s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:05 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=132, name=volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa 1G" returned: 0 in 0.472s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:05 devstack quobyte-client[83627]: System call of process 99302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:05 devstack quobyte-client[83627]: System call of process 99302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img rebase -u -b volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 0.250s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 0.195s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 17:58:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 0.147s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-a673943a-668d-4f66-95dd-dda70e807572-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-a673943a-668d-4f66-95dd-dda70e807572-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8af71ed3-2b59-4f2f-a789-d56676afee67 tempest-VolumesSnapshotListTestJSON-227736118 None] Create snapshot completed successfully Sep 26 17:58:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "cinder-quobyte-a673943a-668d-4f66-95dd-dda70e807572" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-a673943a-668d-4f66-95dd-dda70e807572" acquired by "delete_volume" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3e6c9-a72e-40b7-9444-ec096d77d651]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 0.432s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 1 in 0.765s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 17:58:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a673943a-668d-4f66-95dd-dda70e807572" returned: 0 in 0.161s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-quobyte-a673943a-668d-4f66-95dd-dda70e807572" released by "delete_volume" :: held 1.666s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:08 devstack cinder-volume[83624]: WARNING cinder.quota [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943661629-1038496999 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943661629-1038496999, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:58:08 devstack cinder-volume[83624]: WARNING cinder.quota [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943661629-1038496999 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-943661629-1038496999, it is now deprecated. Please use the default quota class for default quota. Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-95a66814-3a9e-48bc-b3a5-8a34adc202aa-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Created reservations ['54bced70-4edb-46b1-9e65-bd62ead275d7', '4d2ed9b5-f9db-41b1-a789-b4cf98bc4a0b', '6c59dabf-eefc-4afa-b11e-4f2621b53108', '3844e616-0aa0-4ca3-8f71-7e9d3c45de4d'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-95a66814-3a9e-48bc-b3a5-8a34adc202aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-95a66814-3a9e-48bc-b3a5-8a34adc202aa" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-95a66814-3a9e-48bc-b3a5-8a34adc202aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Deleting offline snapshot 95a66814-3a9e-48bc-b3a5-8a34adc202aa of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] snapshot_file for this snap is: volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c5a78-98d9-490f-a12a-a3618a4a32e7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:09 devstack quobyte-client[83627]: System call of process 99314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.111s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:58:09 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Deleted volume successfully. Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7bb0d88b-078f-4f24-9ef8-322a66c190fc tempest-TestInstancesWithCinderVolumes-1373039529 None] Lock "cinder-a673943a-668d-4f66-95dd-dda70e807572-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 1.066s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.276s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7524a5-3ab9-47d8-a639-b4359b2dc69a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:10 devstack quobyte-client[83627]: System call of process 99320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.467s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 0.563s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95a66814-3a9e-48bc-b3a5-8a34adc202aa" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-95a66814-3a9e-48bc-b3a5-8a34adc202aa" released by "_delete_snapshot" :: held 2.600s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" released by "delete_snapshot" :: held 2.625s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:11 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Created reservations ['aa0f3d22-7542-4097-9d32-fd72e07951db', '5cb10374-0e38-49df-b802-491d0ed42654', '9a5e4b0b-8836-45d8-aa84-dffb59e82dc5', 'a3daf238-98fb-4293-8415-7e55cfcb5fe0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:58:11 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Delete snapshot completed successfully. Sep 26 17:58:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2e2cb5d9-658b-4c39-9be2-e955876773e2 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-95a66814-3a9e-48bc-b3a5-8a34adc202aa-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-95c04398-5ceb-40ab-927f-61614bb40a27-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-95c04398-5ceb-40ab-927f-61614bb40a27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:13 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-95c04398-5ceb-40ab-927f-61614bb40a27" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-95c04398-5ceb-40ab-927f-61614bb40a27" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Deleting offline snapshot 95c04398-5ceb-40ab-927f-61614bb40a27 of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] snapshot_file for this snap is: volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b0245-9a60-4848-9136-e2e5355bfea9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.779s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6794c26-0972-4f44-a1c7-2813ca6f1c8d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:14 devstack quobyte-client[83627]: System call of process 99331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.505s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.256s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.95c04398-5ceb-40ab-927f-61614bb40a27" returned: 0 in 0.099s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-95c04398-5ceb-40ab-927f-61614bb40a27" released by "_delete_snapshot" :: held 1.989s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" released by "delete_snapshot" :: held 2.018s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:15 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Created reservations ['bab7d91b-5cbd-4873-87ae-fdef29e466f9', '7b1b91cd-dd6a-4210-82f8-6f8bba111042', '3650cb05-b51f-4cc1-8f70-279da90edaac', '4f5e85e5-6147-43e4-8dcd-5914c97a63ae'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:58:15 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Delete snapshot completed successfully. Sep 26 17:58:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e9e48eb9-1fab-4f0c-b514-7abcc92f5374 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-95c04398-5ceb-40ab-927f-61614bb40a27-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-bec481a8-c494-4b6c-8f2b-f4cec587f439-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-bec481a8-c494-4b6c-8f2b-f4cec587f439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:16 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-bec481a8-c494-4b6c-8f2b-f4cec587f439" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-bec481a8-c494-4b6c-8f2b-f4cec587f439" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Deleting offline snapshot bec481a8-c494-4b6c-8f2b-f4cec587f439 of volume 934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] snapshot_file for this snap is: volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5ceec-778f-450f-a998-10827e180aa9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:16 devstack quobyte-client[83627]: System call of process 99338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.441s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56bb0a-43d1-4e73-8c7b-0875663ae910]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:17 devstack quobyte-client[83627]: System call of process 99341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:17 devstack quobyte-client[83627]: System call of process 99341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9" returned: 0 in 0.564s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.256s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9.bec481a8-c494-4b6c-8f2b-f4cec587f439" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-bec481a8-c494-4b6c-8f2b-f4cec587f439" released by "_delete_snapshot" :: held 1.761s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" released by "delete_snapshot" :: held 1.791s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:18 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Created reservations ['dafb520d-6fc5-4fca-9412-2200bcf6e140', 'c0f8279e-9ee0-4cc1-bb3a-54725597c5fd', 'f4ad17ac-9d71-45e6-89d8-6624dda32b98', '9a30346e-dc7f-47ac-be85-cd324b461776'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:58:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Delete snapshot completed successfully. Sep 26 17:58:18 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8b1094f3-4569-49eb-ad98-f7f770ef214d tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-bec481a8-c494-4b6c-8f2b-f4cec587f439-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-934e5b75-2d88-4085-9576-f1d30dc4f2a9-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-934e5b75-2d88-4085-9576-f1d30dc4f2a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:20 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" acquired by "delete_volume" :: waited 0.023s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e6d5d-1992-447f-a4be-97db368441c7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9" returned: 0 in 0.573s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-934e5b75-2d88-4085-9576-f1d30dc4f2a9" returned: 0 in 0.094s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:20 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-quobyte-934e5b75-2d88-4085-9576-f1d30dc4f2a9" released by "delete_volume" :: held 0.854s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Created reservations ['949b0757-d462-4160-b192-74db2cd21aa1', 'f6e544dc-d5d0-4e36-8b41-dc314517d2e6', '8d574b3d-62c4-49a3-aba1-adff2dd0415b', 'd37e171f-705a-4ba9-adda-fec03872288c'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 17:58:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Deleted volume successfully. Sep 26 17:58:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d68e6c31-be27-4c66-bc8e-54a7b76afe54 tempest-VolumesSnapshotListTestJSON-227736118 None] Lock "cinder-934e5b75-2d88-4085-9576-f1d30dc4f2a9-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 17:58:31 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=64,cinder:SELECT=43,cinder:INSERT=11,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:58:31 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=40,cinder:INSERT=17,cinder:UPDATE=44,cinder:DELETE=7 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:58:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:51 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Flow 'volume_create_manager' (db499f8b-bfd4-480c-bb8c-de1154bc4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0b3c6-72f2-4c67-baa9-aaa98adf986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0b3c6-72f2-4c67-baa9-aaa98adf986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1073647830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197f8e2-3776-4cb4-98ba-74b9a8e90d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d55687d73704be09e3fc6a171430e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:58:52Z,use_quota=True,user_id='80fe51dcac0f4e0e93fa20e4573eafa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8a86ee-981e-45c2-bf48-434793af15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8a86ee-981e-45c2-bf48-434793af15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8863f876-f3da-40a3-96d4-526eec7978b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8863f876-f3da-40a3-96d4-526eec7978b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5197f8e2-3776-4cb4-98ba-74b9a8e90d43', 'volume_name': 'volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0f0e6a-40ae-4acb-86c6-6329682686b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0f0e6a-40ae-4acb-86c6-6329682686b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5e1406-1cbe-450a-ae6b-053f05499bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:52 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume 5197f8e2-3776-4cb4-98ba-74b9a8e90d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43', 'volume_size': 1} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1073647830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197f8e2-3776-4cb4-98ba-74b9a8e90d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d55687d73704be09e3fc6a171430e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:58:52Z,use_quota=True,user_id='80fe51dcac0f4e0e93fa20e4573eafa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Creating volume 5197f8e2-3776-4cb4-98ba-74b9a8e90d43 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:58:52 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:58:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:52 devstack quobyte-client[83627]: System call of process 99396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 17:58:52 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=133, name=volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 1073741824" returned: 0 in 0.747s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:53 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Flow 'volume_create_manager' (a3be3ee4-4410-4592-ae33-ca7552de299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a738c-b812-415d-9f19-b02bdd964543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a738c-b812-415d-9f19-b02bdd964543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-111506826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ad6d2f-236a-4201-bac7-154f72f4219a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d55687d73704be09e3fc6a171430e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:58:52Z,use_quota=True,user_id='80fe51dcac0f4e0e93fa20e4573eafa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e66c8-4997-42b8-9ab1-44f23aa09948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e66c8-4997-42b8-9ab1-44f23aa09948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4aff345-928c-457b-9e42-ed82c55e5b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4aff345-928c-457b-9e42-ed82c55e5b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ad6d2f-236a-4201-bac7-154f72f4219a', 'volume_name': 'volume-b8ad6d2f-236a-4201-bac7-154f72f4219a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4e3856-7750-4273-9108-c213d055f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4e3856-7750-4273-9108-c213d055f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c5305-3ea8-4a35-9ed4-88990b1d802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:53 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume b8ad6d2f-236a-4201-bac7-154f72f4219a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ad6d2f-236a-4201-bac7-154f72f4219a', 'volume_size': 1} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" returned: 0 in 0.569s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] <== create_volume: return (1366ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-111506826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ad6d2f-236a-4201-bac7-154f72f4219a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d55687d73704be09e3fc6a171430e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T15:58:52Z,use_quota=True,user_id='80fe51dcac0f4e0e93fa20e4573eafa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Creating volume b8ad6d2f-236a-4201-bac7-154f72f4219a {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 17:58:53 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 17:58:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:53 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=134, name=volume-b8ad6d2f-236a-4201-bac7-154f72f4219a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5e1406-1cbe-450a-ae6b-053f05499bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602d832-9e8b-48f9-badc-b938a81e7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:54 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 (5197f8e2-3776-4cb4-98ba-74b9a8e90d43): created successfully Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602d832-9e8b-48f9-badc-b938a81e7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Flow 'volume_create_manager' (db499f8b-bfd4-480c-bb8c-de1154bc4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:58:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4a2af7fa-5cd2-466e-af30-86f669fb6639 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Created volume successfully. Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a 1073741824" returned: 0 in 0.631s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a" returned: 0 in 0.191s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] <== create_volume: return (872ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c5305-3ea8-4a35-9ed4-88990b1d802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ad6d2f-236a-4201-bac7-154f72f4219a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbac8e2-bc81-4bca-a0f1-1c7cacc37938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 17:58:54 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume volume-b8ad6d2f-236a-4201-bac7-154f72f4219a (b8ad6d2f-236a-4201-bac7-154f72f4219a): created successfully Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbac8e2-bc81-4bca-a0f1-1c7cacc37938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 17:58:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Flow 'volume_create_manager' (a3be3ee4-4410-4592-ae33-ca7552de299c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 17:58:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-00a5fb12-df6f-4745-a607-bc14636ad23c tempest-TestServerVolumeAttachmentScenario-1525565627 None] Created volume successfully. Sep 26 17:59:04 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:59:04 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 17:59:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 17:59:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.253s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 17:59:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.278s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:00:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:00:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:00:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Flow 'volume_create_manager' (e529dfa0-792a-4075-9a1f-3b43225877c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c560e208-b4a3-454e-b68a-53b79b96ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c560e208-b4a3-454e-b68a-53b79b96ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-209720252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49801a4e-5fe4-4f30-8f3b-bc3a4908af89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423163834634418b889ff440eeb03a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:00:35Z,use_quota=True,user_id='5b4231c1520c44909e421d4327f754e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3796da-511b-4d27-a9e1-7ff0a00e567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3796da-511b-4d27-a9e1-7ff0a00e567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b752f91f-4b27-4929-95bb-a2cf7779eb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b752f91f-4b27-4929-95bb-a2cf7779eb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49801a4e-5fe4-4f30-8f3b-bc3a4908af89', 'volume_name': 'volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a4acc-e6a7-479d-987e-c979f5646933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a4acc-e6a7-479d-987e-c979f5646933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b56009a-1a44-4806-9a9e-156ec038ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume 49801a4e-5fe4-4f30-8f3b-bc3a4908af89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89', 'volume_size': 1} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-209720252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49801a4e-5fe4-4f30-8f3b-bc3a4908af89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423163834634418b889ff440eeb03a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:00:35Z,use_quota=True,user_id='5b4231c1520c44909e421d4327f754e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Creating volume 49801a4e-5fe4-4f30-8f3b-bc3a4908af89 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:00:35 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=135, name=volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 1073741824" returned: 0 in 0.488s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" returned: 0 in 0.083s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] <== create_volume: return (636ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:00:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b56009a-1a44-4806-9a9e-156ec038ed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3186485-18bc-47f7-806f-1a394522a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:00:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 (49801a4e-5fe4-4f30-8f3b-bc3a4908af89): created successfully Sep 26 18:00:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3186485-18bc-47f7-806f-1a394522a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:00:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Flow 'volume_create_manager' (e529dfa0-792a-4075-9a1f-3b43225877c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:00:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-31f258a6-2aad-42be-b746-4dcd418fdbb3 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Created volume successfully. Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce566fd-a7e9-43ef-888f-44cd42d6b29b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" returned: 0 in 0.480s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.551s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8631d2ef-7220-4411-bf56-161d32fd8ba3', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 18:00:37 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:00:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-41435974-72ac-4a28-a5ba-eab9cec9618b req-e6adfc27-fb96-448a-982c-a6e494d2b0dd tempest-TestServerVolumeAttachmentScenario-1525565627 None] attachment_update completed successfully. Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8073800-d254-47d0-adcd-c9df0d9aba21]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" returned: 0 in 0.437s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.495s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1817136-de3b-4d32-a71d-d7f4aceab4dc', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 18:00:41 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:00:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-83de9fd4-1125-42b0-9ec4-dc809eac895f req-11e8cea0-7722-4a43-b2a6-3c832e0cf346 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] attachment_update completed successfully. Sep 26 18:00:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:00:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:00:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bebf858-36ee-4454-9054-afa8a6f1e887]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:00:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:00:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a" returned: 0 in 0.450s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:00:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.497s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:00:51 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb', 'name': 'volume-b8ad6d2f-236a-4201-bac7-154f72f4219a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11003155-ea8a-4cf1-89d8-2cf9d6ab64c1', 'enforce_multipath': True} {{(pid=83624) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 26 18:00:51 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:00:51 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-b14555b7-d1c5-469a-b866-88c639292fde req-5903f826-eac9-4ec5-9508-940e70c119e7 tempest-TestServerVolumeAttachmentScenario-1525565627 None] attachment_update completed successfully. Sep 26 18:01:01 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:01:01 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=6,cinder:SELECT=17 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:01:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-d134f499-4e8d-4251-9fb2-6d6c7528e536 req-8b9feb38-83de-4acb-beb8-19d1353db836 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:08 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-d134f499-4e8d-4251-9fb2-6d6c7528e536 req-8b9feb38-83de-4acb-beb8-19d1353db836 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-d134f499-4e8d-4251-9fb2-6d6c7528e536 req-8b9feb38-83de-4acb-beb8-19d1353db836 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Terminate volume connection completed successfully. Sep 26 18:01:08 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-d134f499-4e8d-4251-9fb2-6d6c7528e536 req-8b9feb38-83de-4acb-beb8-19d1353db836 tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Deleting attachment b1817136-de3b-4d32-a71d-d7f4aceab4dc. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.107s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "cinder-49801a4e-5fe4-4f30-8f3b-bc3a4908af89-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "cinder-49801a4e-5fe4-4f30-8f3b-bc3a4908af89-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:11 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "cinder-quobyte-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "cinder-quobyte-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2818034-d000-4a26-8740-3e1a34bd9bf3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" returned: 0 in 0.556s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" returned: 0 in 0.120s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "cinder-quobyte-49801a4e-5fe4-4f30-8f3b-bc3a4908af89" released by "delete_volume" :: held 0.890s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:12 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Created reservations ['dcb95db6-c60a-464c-9ba5-ccecc05daac6', '2958a936-f4a3-40e3-8e0a-c9dc8fd72663', '81db2754-b354-45fb-8ac6-ebb34f1986b1', 'f2613ae6-14d7-4506-bad1-35ab0d55c4e9'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.133s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:13 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Deleted volume successfully. Sep 26 18:01:13 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-000bca24-cd55-489b-9dd9-5102228c033b tempest-TestServerVolumeAttachScenarioOldVersion-1190930024 None] Lock "cinder-49801a4e-5fe4-4f30-8f3b-bc3a4908af89-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-25098c5a-ade1-4d7f-a4d4-906882ffcfbb req-3c8fa293-426f-4232-b9f4-a69d7b33b832 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-25098c5a-ade1-4d7f-a4d4-906882ffcfbb req-3c8fa293-426f-4232-b9f4-a69d7b33b832 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:18 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-25098c5a-ade1-4d7f-a4d4-906882ffcfbb req-3c8fa293-426f-4232-b9f4-a69d7b33b832 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Terminate volume connection completed successfully. Sep 26 18:01:18 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-25098c5a-ade1-4d7f-a4d4-906882ffcfbb req-3c8fa293-426f-4232-b9f4-a69d7b33b832 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Deleting attachment 11003155-ea8a-4cf1-89d8-2cf9d6ab64c1. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 18:01:28 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:01:28 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:01:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (cb26be9b-f383-4d21-8390-e7f0df4296b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8ffff9-83cc-4e1d-8baa-b02b22f95bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8ffff9-83cc-4e1d-8baa-b02b22f95bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276253636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43e3e48-650b-46c4-905f-54736cda6c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:38Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fb820c-3091-4955-beba-3553133ccfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fb820c-3091-4955-beba-3553133ccfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90035c7a-b07e-444f-8472-8f3bd5671a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90035c7a-b07e-444f-8472-8f3bd5671a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43e3e48-650b-46c4-905f-54736cda6c60', 'volume_name': 'volume-a43e3e48-650b-46c4-905f-54736cda6c60', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad38b458-6ee7-4a2b-b045-c54dc4d6bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad38b458-6ee7-4a2b-b045-c54dc4d6bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235ffa8e-c856-4223-abd9-d8c96cdd545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:38 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Volume a43e3e48-650b-46c4-905f-54736cda6c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43e3e48-650b-46c4-905f-54736cda6c60', 'volume_size': 1} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276253636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43e3e48-650b-46c4-905f-54736cda6c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:38Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Creating volume a43e3e48-650b-46c4-905f-54736cda6c60 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:01:38 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:01:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:38 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=136, name=volume-a43e3e48-650b-46c4-905f-54736cda6c60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60 1073741824" returned: 0 in 0.544s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:39 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (aca9c456-d1d6-4525-b33a-e8007b6ff5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8dd507-a501-401a-808e-887d0e1d21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60" returned: 0 in 0.558s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] <== create_volume: return (1141ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8dd507-a501-401a-808e-887d0e1d21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1455054731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4bf94d-2538-4626-ba25-f2ee915c3d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:39Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22710a8c-1805-49a9-87f0-f98ebb00657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22710a8c-1805-49a9-87f0-f98ebb00657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660109aa-9d53-4ad9-8818-4b91002e12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660109aa-9d53-4ad9-8818-4b91002e12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4bf94d-2538-4626-ba25-f2ee915c3d9c', 'volume_name': 'volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02d15c-3282-44f8-8003-a632709bc09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02d15c-3282-44f8-8003-a632709bc09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51cc924-9e6f-4719-bf7c-09e9f7c70855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:39 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Volume df4bf94d-2538-4626-ba25-f2ee915c3d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c', 'volume_size': 1} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1455054731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4bf94d-2538-4626-ba25-f2ee915c3d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:39Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Creating volume df4bf94d-2538-4626-ba25-f2ee915c3d9c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:01:39 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:01:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:40 devstack quobyte-client[83627]: System call of process 100460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:40 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=137, name=volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:01:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (1a48f778-b82f-4a7e-87c1-9927f6c5ab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179f55d-06e8-4abe-83c7-f17b7b98b72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235ffa8e-c856-4223-abd9-d8c96cdd545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43e3e48-650b-46c4-905f-54736cda6c60', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8572117c-8d3a-40b1-bc69-3fb69c045056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (1fa60e65-6d59-4804-8303-332766f83a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6f1c79-9836-4a26-80c9-0154b5042eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179f55d-06e8-4abe-83c7-f17b7b98b72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502307595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b8196-94d0-4e50-ab62-3e61b3a15467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:39Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52d9597-d365-461f-929c-9e74ff25d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52d9597-d365-461f-929c-9e74ff25d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb509d6e-82fc-4561-954c-26c39901de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb509d6e-82fc-4561-954c-26c39901de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88b8196-94d0-4e50-ab62-3e61b3a15467', 'volume_name': 'volume-b88b8196-94d0-4e50-ab62-3e61b3a15467', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0c8d1e-0728-42c1-9050-6a89a60d235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0c8d1e-0728-42c1-9050-6a89a60d235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4934522-28f9-4cb8-ab6b-1c2ef504274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Volume b88b8196-94d0-4e50-ab62-3e61b3a15467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88b8196-94d0-4e50-ab62-3e61b3a15467', 'volume_size': 1} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c 1073741824" returned: 0 in 0.705s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (8c89b303-e957-49c5-9990-93ee7d2624c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc60320e-a073-4cc8-afb7-575d5021a6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6f1c79-9836-4a26-80c9-0154b5042eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928558734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aeb07fe-969a-4f78-9d1e-3049f81000da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:40Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5383d2-010d-4435-b11f-d2dd5f7797f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5383d2-010d-4435-b11f-d2dd5f7797f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdd90d3-fa73-4cf0-b2b9-b5469f06eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdd90d3-fa73-4cf0-b2b9-b5469f06eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aeb07fe-969a-4f78-9d1e-3049f81000da', 'volume_name': 'volume-4aeb07fe-969a-4f78-9d1e-3049f81000da', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77702055-335d-45a8-afc9-fcfdab31f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77702055-335d-45a8-afc9-fcfdab31f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889e859-d60c-48f5-81fb-963527ae9479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:40 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Volume 4aeb07fe-969a-4f78-9d1e-3049f81000da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aeb07fe-969a-4f78-9d1e-3049f81000da', 'volume_size': 1} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:40 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Volume volume-a43e3e48-650b-46c4-905f-54736cda6c60 (a43e3e48-650b-46c4-905f-54736cda6c60): created successfully Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8572117c-8d3a-40b1-bc69-3fb69c045056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (cb26be9b-f383-4d21-8390-e7f0df4296b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc60320e-a073-4cc8-afb7-575d5021a6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1045471796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25c1e1d-565a-48fe-af67-b6e3d9d41cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:40Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c47979-5140-465a-afab-9ef58310580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c47979-5140-465a-afab-9ef58310580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65bcde2-6de3-40e8-a302-def55ece2594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65bcde2-6de3-40e8-a302-def55ece2594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25c1e1d-565a-48fe-af67-b6e3d9d41cf4', 'volume_name': 'volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66625ed-4f64-4d49-b089-ce9b86830d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66625ed-4f64-4d49-b089-ce9b86830d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59269ae5-ce76-47a0-afb5-f27b3fa4ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Volume e25c1e1d-565a-48fe-af67-b6e3d9d41cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4', 'volume_size': 1} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c" returned: 0 in 0.437s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] <== create_volume: return (1241ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502307595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b8196-94d0-4e50-ab62-3e61b3a15467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:39Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Creating volume b88b8196-94d0-4e50-ab62-3e61b3a15467 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-13245dd7-f45f-4530-9c0a-4a5017ccf22f tempest-CreateVolumesFromImageTest-1888014702 None] Created volume successfully. Sep 26 18:01:41 devstack quobyte-client[83627]: System call of process 100464 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:41 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=138, name=volume-b88b8196-94d0-4e50-ab62-3e61b3a15467, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51cc924-9e6f-4719-bf7c-09e9f7c70855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad65c618-9301-4ba3-8e18-05268ddd24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 1073741824" returned: 0 in 0.437s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Volume volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c (df4bf94d-2538-4626-ba25-f2ee915c3d9c): created successfully Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad65c618-9301-4ba3-8e18-05268ddd24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (aca9c456-d1d6-4525-b33a-e8007b6ff5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-566dfed9-b896-455a-9fa5-8a155a8fd92f tempest-CreateVolumesFromImageTest-1888014702 None] Created volume successfully. Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467" returned: 0 in 0.330s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928558734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aeb07fe-969a-4f78-9d1e-3049f81000da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:40Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Creating volume 4aeb07fe-969a-4f78-9d1e-3049f81000da {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:01:41 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:01:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:42 devstack quobyte-client[83627]: System call of process 100468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:42 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=139, name=volume-4aeb07fe-969a-4f78-9d1e-3049f81000da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4934522-28f9-4cb8-ab6b-1c2ef504274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88b8196-94d0-4e50-ab62-3e61b3a15467', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e205d8ff-3705-41d8-aa0e-86433c6e3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Volume volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 (b88b8196-94d0-4e50-ab62-3e61b3a15467): created successfully Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e205d8ff-3705-41d8-aa0e-86433c6e3cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (1a48f778-b82f-4a7e-87c1-9927f6c5ab80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da 1073741824" returned: 0 in 0.564s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-8d41cbbb-cf52-4244-bfff-14477b453367 req-4eda7194-d0a6-4259-92bd-0b14e1ed237f tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1b3daf2e-c32e-40d5-8dfd-48c74b1533fb tempest-CreateVolumesFromImageTest-1888014702 None] Created volume successfully. Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da" returned: 0 in 0.400s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] <== create_volume: return (995ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:01:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1045471796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25c1e1d-565a-48fe-af67-b6e3d9d41cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a610ec1cd493fb591588a379a9023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:01:40Z,use_quota=True,user_id='479d4511a1d4405283baded0cf696808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Creating volume e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:01:43 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:43 devstack quobyte-client[83627]: System call of process 100474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:43 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=140, name=volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:01:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [req-8d41cbbb-cf52-4244-bfff-14477b453367 req-4eda7194-d0a6-4259-92bd-0b14e1ed237f tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:43 devstack cinder-volume[83624]: INFO cinder.volume.manager [req-8d41cbbb-cf52-4244-bfff-14477b453367 req-4eda7194-d0a6-4259-92bd-0b14e1ed237f tempest-TestServerVolumeAttachmentScenario-1525565627 None] Terminate volume connection completed successfully. Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [req-8d41cbbb-cf52-4244-bfff-14477b453367 req-4eda7194-d0a6-4259-92bd-0b14e1ed237f tempest-TestServerVolumeAttachmentScenario-1525565627 None] Deleting attachment 8631d2ef-7220-4411-bf56-161d32fd8ba3. {{(pid=83624) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1889e859-d60c-48f5-81fb-963527ae9479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aeb07fe-969a-4f78-9d1e-3049f81000da', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670894fd-239d-4538-abce-3126e9f02b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 1073741824" returned: 0 in 0.496s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Volume volume-4aeb07fe-969a-4f78-9d1e-3049f81000da (4aeb07fe-969a-4f78-9d1e-3049f81000da): created successfully Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670894fd-239d-4538-abce-3126e9f02b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (1fa60e65-6d59-4804-8303-332766f83a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:44 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-45ab928e-6f16-4941-a9ea-43eee2badaa6 tempest-CreateVolumesFromImageTest-1888014702 None] Created volume successfully. Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" returned: 0 in 0.341s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] <== create_volume: return (862ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59269ae5-ce76-47a0-afb5-f27b3fa4ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77b2fb8-70a9-40e9-9630-536f350caf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:01:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Volume volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 (e25c1e1d-565a-48fe-af67-b6e3d9d41cf4): created successfully Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77b2fb8-70a9-40e9-9630-536f350caf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Flow 'volume_create_manager' (8c89b303-e957-49c5-9990-93ee7d2624c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:01:44 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f011063c-463b-4950-bfba-8034a468ced9 tempest-CreateVolumesFromImageTest-1888014702 None] Created volume successfully. Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:45 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-quobyte-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[c403f2ec-e0ab-4b28-b823-070e034d701e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" returned: 0 in 0.440s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" returned: 0 in 0.130s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4" released by "delete_volume" :: held 0.817s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Created reservations ['74c69062-3a66-4215-86bb-0a1748d467a8', '799f6014-833b-46aa-8e95-b0fe7d735b5f', 'fb5a0406-c1e4-4747-af40-66a0127e6971', '912bc213-36fd-40cd-9678-91e8264ee0b3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.089s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Deleted volume successfully. Sep 26 18:01:46 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-1bd8ed02-b4f1-439f-aa01-513e14781cbd tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-e25c1e1d-565a-48fe-af67-b6e3d9d41cf4-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-4aeb07fe-969a-4f78-9d1e-3049f81000da-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-4aeb07fe-969a-4f78-9d1e-3049f81000da-delete_volume" acquired by "delete_volume" :: waited 0.247s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:48 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-quobyte-4aeb07fe-969a-4f78-9d1e-3049f81000da" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-4aeb07fe-969a-4f78-9d1e-3049f81000da" acquired by "delete_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a401076-29dc-4cbc-8be8-2491386af608]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:48 devstack quobyte-client[83627]: System call of process 100521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da" returned: 0 in 0.556s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4aeb07fe-969a-4f78-9d1e-3049f81000da" returned: 0 in 0.092s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-4aeb07fe-969a-4f78-9d1e-3049f81000da" released by "delete_volume" :: held 0.848s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Created reservations ['4672faf8-00ee-4d6c-8f12-9606ae8df1b3', 'b1d95d9a-c36b-44d6-9052-1170dd52c99c', '1807262e-7b9e-477d-ba60-be4ca349a8ee', 'be553c1f-1ab8-4c85-af3d-b03b11cc3b36'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.121s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:49 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Deleted volume successfully. Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-b88b8196-94d0-4e50-ab62-3e61b3a15467-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8c13fc31-2405-4c64-97c1-7c930c68fb31 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-4aeb07fe-969a-4f78-9d1e-3049f81000da-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-b88b8196-94d0-4e50-ab62-3e61b3a15467-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-quobyte-b88b8196-94d0-4e50-ab62-3e61b3a15467" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-b88b8196-94d0-4e50-ab62-3e61b3a15467" acquired by "delete_volume" :: waited 0.038s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7612b-01c5-4027-a2d2-e25acab47e48]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467" returned: 0 in 0.791s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b88b8196-94d0-4e50-ab62-3e61b3a15467" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-b88b8196-94d0-4e50-ab62-3e61b3a15467" released by "delete_volume" :: held 1.229s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Created reservations ['d6f963a3-a357-48be-b80b-074ae035a283', 'a4a00239-1719-4ca3-97e9-7a0855e54c0e', '5c7a85f6-5e4c-4d84-91e1-b3b4dd84dbbe', '67226994-329b-4f06-ad5f-a98f58aebfe0'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-df4bf94d-2538-4626-ba25-f2ee915c3d9c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.280s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:52 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Deleted volume successfully. Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-df4bf94d-2538-4626-ba25-f2ee915c3d9c-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-527e1ad2-b21d-45b7-9286-15d9971df52f tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-b88b8196-94d0-4e50-ab62-3e61b3a15467-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-quobyte-df4bf94d-2538-4626-ba25-f2ee915c3d9c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-df4bf94d-2538-4626-ba25-f2ee915c3d9c" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e317b9-b000-4ea7-8762-b6334f390cee]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:53 devstack quobyte-client[83627]: System call of process 100535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:53 devstack quobyte-client[83627]: System call of process 100535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:01:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c" returned: 0 in 0.472s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-df4bf94d-2538-4626-ba25-f2ee915c3d9c" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-df4bf94d-2538-4626-ba25-f2ee915c3d9c" released by "delete_volume" :: held 0.795s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Created reservations ['43f4c99c-ced2-4bc3-9e0e-4ff8861ddae3', 'c863c96d-2c46-4a73-8282-e451c1490e47', '382c6d4c-f761-44be-8736-57e47ec75f9b', '1059555f-fb35-4b54-847b-af50f0d3148a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.101s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Deleted volume successfully. Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-eb96a576-ff7e-4dfa-8d46-faf1dc9e3294 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-df4bf94d-2538-4626-ba25-f2ee915c3d9c-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-a43e3e48-650b-46c4-905f-54736cda6c60-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-a43e3e48-650b-46c4-905f-54736cda6c60-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:54 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "cinder-quobyte-a43e3e48-650b-46c4-905f-54736cda6c60" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-a43e3e48-650b-46c4-905f-54736cda6c60" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c31c24-4113-468c-8ef8-0357c525afbb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a43e3e48-650b-46c4-905f-54736cda6c60" returned: 0 in 0.109s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-quobyte-a43e3e48-650b-46c4-905f-54736cda6c60" released by "delete_volume" :: held 0.709s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Created reservations ['6c838ffd-01dc-4f5c-888a-fe9dc5631df4', 'e21edd10-8533-4a7c-8b3a-9b47485f3716', '9031622f-11f1-494e-b6b8-84eb29a90580', '3f26ae27-7cbe-4230-ab2e-1a1bec944dd3'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.105s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Deleted volume successfully. Sep 26 18:01:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-ace1c955-ef90-43d5-a382-2d5440bd6ac1 tempest-CreateVolumesFromImageTest-1888014702 None] Lock "cinder-a43e3e48-650b-46c4-905f-54736cda6c60-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "cinder-b8ad6d2f-236a-4201-bac7-154f72f4219a-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-b8ad6d2f-236a-4201-bac7-154f72f4219a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "cinder-quobyte-b8ad6d2f-236a-4201-bac7-154f72f4219a" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-quobyte-b8ad6d2f-236a-4201-bac7-154f72f4219a" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2704e00-ece1-481f-b858-6560a37e9b34]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a" returned: 0 in 0.465s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b8ad6d2f-236a-4201-bac7-154f72f4219a" returned: 0 in 0.137s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-quobyte-b8ad6d2f-236a-4201-bac7-154f72f4219a" released by "delete_volume" :: held 0.811s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Created reservations ['a831bfb1-51aa-46f0-8a4e-4d534d01c76e', '5c763d16-df9c-4472-b5be-ed3f1d8f5f6b', '22067b30-fb8b-418d-9446-4dac043285d2', '5e8b6afb-0470-4a7d-bd45-f05d5274595c'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.110s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:01:58 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:01:58 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Deleted volume successfully. Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-39fbbb99-6ec6-4475-933f-55673fd891f6 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-b8ad6d2f-236a-4201-bac7-154f72f4219a-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "cinder-5197f8e2-3776-4cb4-98ba-74b9a8e90d43-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-5197f8e2-3776-4cb4-98ba-74b9a8e90d43-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:59 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "cinder-quobyte-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-quobyte-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" acquired by "delete_volume" :: waited 0.014s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca4633c-2e39-475e-98ed-27b5da5360ad]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:01:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" returned: 0 in 0.595s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" returned: 0 in 0.128s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-quobyte-5197f8e2-3776-4cb4-98ba-74b9a8e90d43" released by "delete_volume" :: held 0.909s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Created reservations ['d40e03d5-1900-4a10-8cc4-3cc57888e37b', 'bf89beef-c36b-44bf-a5e0-50889fc31abe', '32b44dfc-7b31-456b-880e-9c65a2eea32c', 'a3a86d2e-0216-4119-aaba-828460e83eff'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.146s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:01 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:02:01 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Deleted volume successfully. Sep 26 18:02:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-47e70c83-b479-4dc6-9582-87ad15cea8f1 tempest-TestServerVolumeAttachmentScenario-1525565627 None] Lock "cinder-5197f8e2-3776-4cb4-98ba-74b9a8e90d43-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Flow 'volume_create_manager' (4cd23c62-194e-4718-8720-ba99c3e44d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a260d5-69bd-4718-9816-23b82f6533f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a260d5-69bd-4718-9816-23b82f6533f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13aa449-95bb-4e5a-a8cc-427991a0fa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41709adde1a14b95817ac6e2c6d6864b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:02:03Z,use_quota=True,user_id='c1104a386703486e8340d28ad85d8cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d978cb-400d-486a-8359-01b3c1fee6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d978cb-400d-486a-8359-01b3c1fee6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43be1d0a-9220-423c-865a-849b235adc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:03 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43be1d0a-9220-423c-865a-849b235adc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a13aa449-95bb-4e5a-a8cc-427991a0fa80', 'volume_name': 'volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80', 'volume_size': 1, 'image_id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0256aa6c6cd89490f97c084a4a891fd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41709adde1a14b95817ac6e2c6d6864b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50422bb20a2c9dd0425acd2d32eb2f77eab932323e09bdf7817a7227f1a60719a9519d584c0cdeff6028d3126f55c9b35b81712befde1f2f7adde0638d7e9a81', 'id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'created_at': datetime.datetime(2025, 9, 26, 16, 2, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43b6883-b0cd-48de-9025-09ec1d5acf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43b6883-b0cd-48de-9025-09ec1d5acf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146085b5-890d-41ba-b8bc-331dd3f01615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:04 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Volume a13aa449-95bb-4e5a-a8cc-427991a0fa80: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80', 'volume_size': 1, 'image_id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0256aa6c6cd89490f97c084a4a891fd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41709adde1a14b95817ac6e2c6d6864b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50422bb20a2c9dd0425acd2d32eb2f77eab932323e09bdf7817a7227f1a60719a9519d584c0cdeff6028d3126f55c9b35b81712befde1f2f7adde0638d7e9a81', 'id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'created_at': datetime.datetime(2025, 9, 26, 16, 2, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2/file', 'properties': {}}, 'image_service': } Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Cloning a13aa449-95bb-4e5a-a8cc-427991a0fa80 from image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 18:02:04 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Image download 0.00 MB at 0.00 MB/s Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[524cc6d6-b8ef-4f2f-b516-27dc95f4b694]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:04 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD Sep 26 18:02:04 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:02:06 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 26 18:02:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 0 in 2.709s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:07 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD Sep 26 18:02:07 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:02:09 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 1 in 2.967s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Temporary image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 is fetched for user c1104a386703486e8340d28ad85d8cca. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.296s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eba982-95f9-4061-a83c-38d28385723e]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:11 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD Sep 26 18:02:11 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:02:13 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 26 18:02:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 0 in 2.681s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:13 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=67,cinder:SELECT=46,cinder:DELETE=5,cinder:INSERT=15 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:02:14 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD Sep 26 18:02:14 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:02:16 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 1 in 2.971s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13aa449-95bb-4e5a-a8cc-427991a0fa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41709adde1a14b95817ac6e2c6d6864b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:02:03Z,use_quota=True,user_id='c1104a386703486e8340d28ad85d8cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Creating volume a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:02:16 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:16 devstack quobyte-client[83627]: System call of process 100588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:16 devstack quobyte-client[83627]: System call of process 100588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:16 devstack quobyte-client[83627]: System call of process 100588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:16 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=141, name=volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 1073741824" returned: 0 in 0.423s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 0 in 0.162s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] <== create_volume: return (696ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Attempting download of 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}])) to volume a13aa449-95bb-4e5a-a8cc-427991a0fa80. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465a377-674c-4bcc-9aa9-e71a7b18de00]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_43d8upw6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_43d8upw6" returned: 0 in 0.412s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_43d8upw6 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_43d8upw6" returned: 1 in 0.399s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_43d8upw6' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c25c1-0888-4892-b630-c2b8ea02b6d5]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 was raw, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:19 devstack quobyte-client[83627]: System call of process 100605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:19 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=141, name=volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 0 in 0.183s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f8e407e-f177-4f2e-9d3a-fb805fba8ce2_q59w2qstdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 18:02:19 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Converted 0.00 MB image at 0.00 MB/s Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:19 devstack quobyte-client[83627]: System call of process 100608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:19 devstack quobyte-client[83627]: System call of process 100608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 1G" returned: 0 in 0.159s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb64b10-337e-4072-ba0e-4ff85e225239]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:20 devstack quobyte-client[83627]: System call of process 100611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 0 in 0.518s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 1 in 0.454s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Downloaded image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}])) to volume a13aa449-95bb-4e5a-a8cc-427991a0fa80 successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Temporary image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 for user c1104a386703486e8340d28ad85d8cca is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 18:02:20 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Marking volume a13aa449-95bb-4e5a-a8cc-427991a0fa80 as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Copying metadata from image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 to a13aa449-95bb-4e5a-a8cc-427991a0fa80. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Creating volume glance metadata for volume a13aa449-95bb-4e5a-a8cc-427991a0fa80 backed by image 3f8e407e-f177-4f2e-9d3a-fb805fba8ce2 with: {'image_id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0256aa6c6cd89490f97c084a4a891fd5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146085b5-890d-41ba-b8bc-331dd3f01615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80', 'volume_size': 1, 'image_id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0256aa6c6cd89490f97c084a4a891fd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41709adde1a14b95817ac6e2c6d6864b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50422bb20a2c9dd0425acd2d32eb2f77eab932323e09bdf7817a7227f1a60719a9519d584c0cdeff6028d3126f55c9b35b81712befde1f2f7adde0638d7e9a81', 'id': '3f8e407e-f177-4f2e-9d3a-fb805fba8ce2', 'created_at': datetime.datetime(2025, 9, 26, 16, 2, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f8e407e-f177-4f2e-9d3a-fb805fba8ce2/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e9d03b-6198-4155-a4e6-5bb236cfde1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:21 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Volume volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 (a13aa449-95bb-4e5a-a8cc-427991a0fa80): created successfully Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e9d03b-6198-4155-a4e6-5bb236cfde1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:21 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Flow 'volume_create_manager' (4cd23c62-194e-4718-8720-ba99c3e44d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:21 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-400257e1-fead-4267-9974-3605eb5b0202 tempest-VolumeImageDependencyTests-301589101 None] Created volume successfully. Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Acquiring lock "cinder-a13aa449-95bb-4e5a-a8cc-427991a0fa80-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "cinder-a13aa449-95bb-4e5a-a8cc-427991a0fa80-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:22 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Acquiring lock "cinder-quobyte-a13aa449-95bb-4e5a-a8cc-427991a0fa80" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "cinder-quobyte-a13aa449-95bb-4e5a-a8cc-427991a0fa80" acquired by "delete_volume" :: waited 0.022s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[565660c8-5a7e-49ec-b24c-cfcbf95ac0dc]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 0 in 0.418s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:23 devstack quobyte-client[83627]: System call of process 100619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:23 devstack quobyte-client[83627]: System call of process 100619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 1 in 0.395s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a13aa449-95bb-4e5a-a8cc-427991a0fa80" returned: 0 in 0.100s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:23 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "cinder-quobyte-a13aa449-95bb-4e5a-a8cc-427991a0fa80" released by "delete_volume" :: held 1.242s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Created reservations ['f56442e6-227f-4a94-af7f-2f7f45989873', '994f2bc4-0aa2-4aea-875f-ced0e09c8eb9', '944ae760-0dd7-494b-b7d7-a234e91ff3fe', '17119853-43f2-4526-bdf7-3c7c966c0981'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.103s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:02:24 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Deleted volume successfully. Sep 26 18:02:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0196baf4-1dca-4cda-938f-d0619694842b tempest-VolumeImageDependencyTests-301589101 None] Lock "cinder-a13aa449-95bb-4e5a-a8cc-427991a0fa80-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:34 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=48,cinder:UPDATE=84,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:02:34 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=5,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:02:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Flow 'volume_create_manager' (621978d9-2b02-41d3-92a1-7373bdc792b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af684e9-83fc-4fd6-93d7-88d476a95bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af684e9-83fc-4fd6-93d7-88d476a95bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1274075667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2adfd03f2554f509f64a99d9afb8751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:02:42Z,use_quota=True,user_id='ce77f4ac6a33473f8a08bc80cec8dbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0f28d-0201-4204-814c-912a7890bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f0f28d-0201-4204-814c-912a7890bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f9ea85-59cd-429a-a335-6351779cfbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f9ea85-59cd-429a-a335-6351779cfbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd', 'volume_name': 'volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd7d743-1c1b-4014-8ff8-f91e861cfa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd7d743-1c1b-4014-8ff8-f91e861cfa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc1cf49-3192-4abd-93dc-edfa8f7bb657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Volume 54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd', 'volume_size': 1} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1274075667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2adfd03f2554f509f64a99d9afb8751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:02:42Z,use_quota=True,user_id='ce77f4ac6a33473f8a08bc80cec8dbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Creating volume 54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:02:42 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:42 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=142, name=volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:02:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd 1073741824" returned: 0 in 0.307s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.086s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] <== create_volume: return (460ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.472s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc1cf49-3192-4abd-93dc-edfa8f7bb657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c524c4df-58c3-4e53-bdc4-1c300410e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:43 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Volume volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd (54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd): created successfully Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c524c4df-58c3-4e53-bdc4-1c300410e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Flow 'volume_create_manager' (621978d9-2b02-41d3-92a1-7373bdc792b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:43 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e3cf7443-d1f2-4782-a25f-1cc6535bba93 tempest-SnapshotDependencyTests-1484985299 None] Created volume successfully. Sep 26 18:02:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Creating offline snapshot 7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 of volume 54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 18:02:44 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e589fc-2c18-4baa-8865-e72dfeb0ff88]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.389s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:45 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=143, name=volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 1G" returned: 0 in 0.234s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): qemu-img rebase -u -b volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:45 devstack quobyte-client[83627]: System call of process 100668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "qemu-img rebase -u -b volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.147s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 18:02:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.104s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.info" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.info" returned: 0 in 0.084s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.452s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:46 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f380514d-6522-437a-98cc-e96311fe7698 tempest-SnapshotDependencyTests-1484985299 None] Create snapshot completed successfully Sep 26 18:02:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Flow 'volume_create_manager' (d4f99613-cf80-44eb-94e5-5eab29e5ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1c792a-3705-42dc-88ac-206aaed85ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1c792a-3705-42dc-88ac-206aaed85ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349cc012-abdc-47b3-8fb4-d58236152a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2adfd03f2554f509f64a99d9afb8751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:02:47Z,use_quota=True,user_id='ce77f4ac6a33473f8a08bc80cec8dbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff14022b-5dad-477a-8014-094c3c58921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff14022b-5dad-477a-8014-094c3c58921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958a78f3-a471-45dc-8796-b32a316ad040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958a78f3-a471-45dc-8796-b32a316ad040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '349cc012-abdc-47b3-8fb4-d58236152a4b', 'volume_name': 'volume-349cc012-abdc-47b3-8fb4-d58236152a4b', 'volume_size': 1, 'snapshot_id': '7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687fe24d-98e5-4af2-9717-952c83479b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687fe24d-98e5-4af2-9717-952c83479b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dabf23-bfc1-4139-a674-cb9f24dc163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:47 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Volume 349cc012-abdc-47b3-8fb4-d58236152a4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-349cc012-abdc-47b3-8fb4-d58236152a4b', 'volume_size': 1, 'snapshot_id': '7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585'} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-349cc012-abdc-47b3-8fb4-d58236152a4b" by "_create_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-349cc012-abdc-47b3-8fb4-d58236152a4b" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Creating volume 349cc012-abdc-47b3-8fb4-d58236152a4b from snapshot 7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" by "_copy_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] snapshot: 7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585, volume: 349cc012-abdc-47b3-8fb4-d58236152a4b, {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102ac7c-d7bb-4e92-b58e-80e0ab33598e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:48 devstack quobyte-client[83627]: System call of process 100675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.373s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Creating direct copy from snapshot {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bc0c3-71e8-496c-acf8-560232ddd221]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.382s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG cinder.utils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b not found in is_blk_device check {{(pid=83624) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 26 18:02:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:48 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=145, name=volume-349cc012-abdc-47b3-8fb4-d58236152a4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b" returned: 0 in 4.540s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[97581844-bbdf-445b-b6ba-0d286f431f5e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.551s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 18:02:53 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Converted 1024.00 MB image at 224.56 MB/s Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b" returned: 0 in 0.084s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" released by "_copy_volume_from_snapshot" :: held 6.305s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-349cc012-abdc-47b3-8fb4-d58236152a4b" released by "_create_volume_from_snapshot" :: held 6.355s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.373s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dabf23-bfc1-4139-a674-cb9f24dc163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349cc012-abdc-47b3-8fb4-d58236152a4b', 'volume_size': 1, 'snapshot_id': '7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe01ab4d-1022-4bd5-bd9a-fc6769a3a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:02:54 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Volume volume-349cc012-abdc-47b3-8fb4-d58236152a4b (349cc012-abdc-47b3-8fb4-d58236152a4b): created successfully Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe01ab4d-1022-4bd5-bd9a-fc6769a3a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:02:54 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Flow 'volume_create_manager' (d4f99613-cf80-44eb-94e5-5eab29e5ab76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:02:54 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a1b321df-551b-4950-b4b6-f2992c4f36d8 tempest-SnapshotDependencyTests-1484985299 None] Created volume successfully. Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:55 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Deleting offline snapshot 7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 of volume 54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] snapshot_file for this snap is: volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8e3be3-3c5c-47a9-bac8-ea5fe9624ad7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:55 devstack quobyte-client[83627]: System call of process 100697 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.391s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26b9e0-4202-47bf-9a39-88eb977a519b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.379s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:56 devstack quobyte-client[83627]: System call of process 100703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.201s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd.7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585" released by "_delete_snapshot" :: held 1.363s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" released by "delete_snapshot" :: held 1.384s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Created reservations ['99591d30-b95a-4302-89a0-4ff84e577db7', '3fbaaad3-38d0-4559-b984-f491cb2ca889', 'a5b5cc34-0761-4345-8f15-f8df109e1808', '99c6b6cb-96bf-485d-9cce-e627a925ca4a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:02:57 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Delete snapshot completed successfully. Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7af12784-152a-489f-8907-ba99e45ee721 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-7aa17e24-7fde-4ce7-9d9c-b83ba3c1f585-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:57 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb6c68d-c662-496e-b506-e0a7103f65b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.394s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" returned: 0 in 0.105s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd" released by "delete_volume" :: held 0.657s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Created reservations ['a173c6c5-7e60-49cf-bd56-73f02dcd412b', '58c0e326-f80f-4980-838f-74d0927e9b36', '08edf4ee-d2ff-47b2-b350-0d79a4c15dfb', 'd58b8064-9ebd-41e0-af30-e8517efaaa56'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-349cc012-abdc-47b3-8fb4-d58236152a4b-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.284s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:58 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:02:59 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Deleted volume successfully. Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-349cc012-abdc-47b3-8fb4-d58236152a4b-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0871dbaa-7fed-456a-9294-0cb8e314c736 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-54150fa8-9fbd-43d1-b77d-2bbb79f1b1cd-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:02:59 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[293cb569-ca2d-4d7c-96b1-55440181271a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b" returned: 0 in 0.389s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-349cc012-abdc-47b3-8fb4-d58236152a4b" returned: 0 in 0.094s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:02:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-quobyte-349cc012-abdc-47b3-8fb4-d58236152a4b" released by "delete_volume" :: held 0.666s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Created reservations ['29786774-7728-4e38-9603-7e5d45db993d', '93fd5684-2307-41c5-8343-6da9f3bebdde', '2717f381-a134-4654-9c91-9f3e843236c3', 'cfbe5991-d7d8-4940-bec2-ba5907680a0a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.096s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Deleted volume successfully. Sep 26 18:03:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-55a9180f-c3d4-46d3-9611-d18af6ed4f00 tempest-SnapshotDependencyTests-1484985299 None] Lock "cinder-349cc012-abdc-47b3-8fb4-d58236152a4b-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:09 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:10 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:UPDATE=32,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=10 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:03:10 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:DELETE=4,cinder:INSERT=2 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:03:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (de1c6ebe-9df4-40d1-98e6-b5f1c4e881e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963fe401-c138-4b03-8449-edfc541f7146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (29faaa58-1f5c-4d35-854b-501f15dbf24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e42fdd-a902-405f-9660-da2840ffda78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963fe401-c138-4b03-8449-edfc541f7146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227483556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e4ec06-eba0-48d1-adbd-92c61af6c159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa71f27b-05ab-4f3e-941a-b872c6eb8da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa71f27b-05ab-4f3e-941a-b872c6eb8da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ab078-5c4f-4f49-8716-46d5b30358a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ab078-5c4f-4f49-8716-46d5b30358a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e4ec06-eba0-48d1-adbd-92c61af6c159', 'volume_name': 'volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1cde26-4b75-4321-8e3a-64093d89612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1cde26-4b75-4321-8e3a-64093d89612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6a86c1-4ef5-4f84-8e51-c19b6003fccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume b4e4ec06-eba0-48d1-adbd-92c61af6c159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159', 'volume_size': 1} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227483556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e4ec06-eba0-48d1-adbd-92c61af6c159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:28 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:28 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=146, name=volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e42fdd-a902-405f-9660-da2840ffda78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002752177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babb00a1-1cc0-44c5-b018-64e8922828cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addb941b-68da-4523-a72c-faed84576ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addb941b-68da-4523-a72c-faed84576ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0946c0ee-1abc-4951-bfcd-397baf9d45a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0946c0ee-1abc-4951-bfcd-397baf9d45a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babb00a1-1cc0-44c5-b018-64e8922828cf', 'volume_name': 'volume-babb00a1-1cc0-44c5-b018-64e8922828cf', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eb339f-5468-48db-81bb-423cc1150804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eb339f-5468-48db-81bb-423cc1150804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a9f2d1-6fa6-44ef-9ffb-d461c47b567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:28 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Volume babb00a1-1cc0-44c5-b018-64e8922828cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babb00a1-1cc0-44c5-b018-64e8922828cf', 'volume_size': 1} Sep 26 18:03:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 1073741824" returned: 0 in 0.785s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (8a63858a-a27d-4c92-960b-cf32bac1cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db1ae98-9375-4f8d-bbe7-4f0f2dbe82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (5fae4adf-b63c-472a-88ae-529d48715a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ae694d-b5e1-437e-a2f1-95506defb141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159" returned: 0 in 0.804s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db1ae98-9375-4f8d-bbe7-4f0f2dbe82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986197316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bc5b35-3d76-44f1-9257-e14192904eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:29Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0323d119-8bd7-4abb-996a-66e9a64e1280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0323d119-8bd7-4abb-996a-66e9a64e1280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc44f72-1f26-494b-acf4-2c20ad1c3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc44f72-1f26-494b-acf4-2c20ad1c3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bc5b35-3d76-44f1-9257-e14192904eee', 'volume_name': 'volume-f9bc5b35-3d76-44f1-9257-e14192904eee', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd313fc7-673e-48bc-b7f4-58cf25620da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd313fc7-673e-48bc-b7f4-58cf25620da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c092104a-86c8-44f7-b92e-0dc54d9a7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Volume f9bc5b35-3d76-44f1-9257-e14192904eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bc5b35-3d76-44f1-9257-e14192904eee', 'volume_size': 1} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1657ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002752177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babb00a1-1cc0-44c5-b018-64e8922828cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Creating volume babb00a1-1cc0-44c5-b018-64e8922828cf {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:30 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:30 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=147, name=volume-babb00a1-1cc0-44c5-b018-64e8922828cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:30 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (118aed82-68a3-46a5-980c-ae1d37a87d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9ec363-32bf-454f-9f2c-eb8ddd8d4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ae694d-b5e1-437e-a2f1-95506defb141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554380666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d7f8db-a1f7-40f9-b172-00b3ea57cd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f07351-db81-4447-b49f-ad7031b43e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f07351-db81-4447-b49f-ad7031b43e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb29e3a4-4d8f-426e-b2da-d8193b53e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb29e3a4-4d8f-426e-b2da-d8193b53e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d7f8db-a1f7-40f9-b172-00b3ea57cd49', 'volume_name': 'volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f96fbb-b3fe-4f75-88bf-149085d6dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f96fbb-b3fe-4f75-88bf-149085d6dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f94d55-b5cd-49a2-89cc-20582cdfc257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Volume 67d7f8db-a1f7-40f9-b172-00b3ea57cd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49', 'volume_size': 1} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6a86c1-4ef5-4f84-8e51-c19b6003fccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee42f0e-5cc7-4831-b082-ea0c9314982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9ec363-32bf-454f-9f2c-eb8ddd8d4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118799907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261db5fd-93a5-448c-91f9-a86ef2416a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:30Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3558f801-8b56-41a3-934b-ec94a84b51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3558f801-8b56-41a3-934b-ec94a84b51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6da9aa-d38f-43c4-8efd-455f1308e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6da9aa-d38f-43c4-8efd-455f1308e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261db5fd-93a5-448c-91f9-a86ef2416a5c', 'volume_name': 'volume-261db5fd-93a5-448c-91f9-a86ef2416a5c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fde6dd-2e81-416d-b73d-fbc4564b2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fde6dd-2e81-416d-b73d-fbc4564b2d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839d423b-fbd7-4666-b5c7-efc0b2ed1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:30 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Volume 261db5fd-93a5-448c-91f9-a86ef2416a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261db5fd-93a5-448c-91f9-a86ef2416a5c', 'volume_size': 1} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf 1073741824" returned: 0 in 0.714s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 (b4e4ec06-eba0-48d1-adbd-92c61af6c159): created successfully Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee42f0e-5cc7-4831-b082-ea0c9314982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (de1c6ebe-9df4-40d1-98e6-b5f1c4e881e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:31 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-33cb4b2f-8da0-4599-ad4f-5b46a1ff904e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:31 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (25337dec-8b79-43c0-a55e-54953f1dd805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a44b084-ab1d-41cf-a9a3-4b4eb7f275f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf" returned: 0 in 0.561s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] <== create_volume: return (1298ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986197316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bc5b35-3d76-44f1-9257-e14192904eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:29Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Creating volume f9bc5b35-3d76-44f1-9257-e14192904eee {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:31 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:31 devstack quobyte-client[83627]: System call of process 100789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:31 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=148, name=volume-f9bc5b35-3d76-44f1-9257-e14192904eee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a44b084-ab1d-41cf-a9a3-4b4eb7f275f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292214148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7faecb8-4d8e-4173-a419-797019b149a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:30Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d727bf-5d64-445c-8884-383e53ad7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d727bf-5d64-445c-8884-383e53ad7fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6feeed-9ecb-4157-a3f1-f0866322b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6feeed-9ecb-4157-a3f1-f0866322b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7faecb8-4d8e-4173-a419-797019b149a1', 'volume_name': 'volume-a7faecb8-4d8e-4173-a419-797019b149a1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fd42c2-4bb3-4bd9-8d2c-4d8c021646e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fd42c2-4bb3-4bd9-8d2c-4d8c021646e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0c97a-6af2-4a1f-8460-74612105124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Volume a7faecb8-4d8e-4173-a419-797019b149a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7faecb8-4d8e-4173-a419-797019b149a1', 'volume_size': 1} Sep 26 18:03:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a9f2d1-6fa6-44ef-9ffb-d461c47b567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babb00a1-1cc0-44c5-b018-64e8922828cf', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edde79db-93b9-4011-a159-cf31ab622bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee 1073741824" returned: 0 in 0.696s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Volume volume-babb00a1-1cc0-44c5-b018-64e8922828cf (babb00a1-1cc0-44c5-b018-64e8922828cf): created successfully Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edde79db-93b9-4011-a159-cf31ab622bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (29faaa58-1f5c-4d35-854b-501f15dbf24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Flow 'volume_create_manager' (3cbf94fd-4b2a-45cf-8149-f7231c3720f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b7aa1-9aa8-47d1-bfe4-ded71ed83466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:32 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c1c377db-5aa9-4f8f-a265-e64b952dc709 tempest-CreateVolumesFromImageTest-1328921500 None] Created volume successfully. Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee" returned: 0 in 0.482s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] <== create_volume: return (1244ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554380666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d7f8db-a1f7-40f9-b172-00b3ea57cd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:28Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Creating volume 67d7f8db-a1f7-40f9-b172-00b3ea57cd49 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:32 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:32 devstack quobyte-client[83627]: System call of process 100793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:32 devstack quobyte-client[83627]: System call of process 100793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:32 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=149, name=volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b7aa1-9aa8-47d1-bfe4-ded71ed83466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05140ad3-f94e-484a-b109-eb6134d71ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b46d1bab4d81426390ce39db740aae16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:32Z,use_quota=True,user_id='3f0648803f824c7ba5d2b5a7f625381f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d1769-d27c-4e48-bf78-1480e8a40db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d1769-d27c-4e48-bf78-1480e8a40db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c64056-91ba-4824-8fc4-16ed6b1d6c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.image.glance [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Creating Keystone auth plugin from conf {{(pid=83624) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c092104a-86c8-44f7-b92e-0dc54d9a7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bc5b35-3d76-44f1-9257-e14192904eee', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f67d267-d1b2-46f5-8753-bec0da44e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 1073741824" returned: 0 in 0.614s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Volume volume-f9bc5b35-3d76-44f1-9257-e14192904eee (f9bc5b35-3d76-44f1-9257-e14192904eee): created successfully Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f67d267-d1b2-46f5-8753-bec0da44e185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (8a63858a-a27d-4c92-960b-cf32bac1cbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-3f6b2c70-ddb5-4bb4-805d-a962d0b31cc4 tempest-CreateVolumesFromImageTest-1328921500 None] Created volume successfully. Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" returned: 0 in 0.474s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] <== create_volume: return (1119ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.995s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118799907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261db5fd-93a5-448c-91f9-a86ef2416a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:30Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Creating volume 261db5fd-93a5-448c-91f9-a86ef2416a5c {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:33 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:34 devstack quobyte-client[83627]: System call of process 100797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:34 devstack quobyte-client[83627]: System call of process 100797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:34 devstack quobyte-client[83627]: System call of process 100797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:34 devstack quobyte-client[83627]: System call of process 100797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:34 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=150, name=volume-261db5fd-93a5-448c-91f9-a86ef2416a5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f94d55-b5cd-49a2-89cc-20582cdfc257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3065e3eb-b8e9-4d0a-9b7b-01eeed746b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c 1073741824" returned: 0 in 0.538s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:34 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Volume volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 (67d7f8db-a1f7-40f9-b172-00b3ea57cd49): created successfully Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3065e3eb-b8e9-4d0a-9b7b-01eeed746b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (5fae4adf-b63c-472a-88ae-529d48715a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c64056-91ba-4824-8fc4-16ed6b1d6c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05140ad3-f94e-484a-b109-eb6134d71ab1', 'volume_name': 'volume-05140ad3-f94e-484a-b109-eb6134d71ab1', 'volume_size': 1, 'image_id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b7b2d901b713f8e905a71ebf0b10ae3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b46d1bab4d81426390ce39db740aae16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a91d2987350041930ab993bf2d1989cf8d4e5f6c9d9ccdb5046304bfdcfcd8a3786d8b3254b08811e3b2dd940b6b3e67c2c7faa449177e03692765d19d4f023', 'id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'created_at': datetime.datetime(2025, 9, 26, 16, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d65a9a1-65a8-426c-ba23-51a24bda4153/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac599564-6894-49e6-84bd-ec2a3cf7d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac599564-6894-49e6-84bd-ec2a3cf7d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e918d-3072-427c-b2f7-ba481ab406e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:34 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Volume 05140ad3-f94e-484a-b109-eb6134d71ab1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05140ad3-f94e-484a-b109-eb6134d71ab1', 'volume_size': 1, 'image_id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b7b2d901b713f8e905a71ebf0b10ae3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b46d1bab4d81426390ce39db740aae16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a91d2987350041930ab993bf2d1989cf8d4e5f6c9d9ccdb5046304bfdcfcd8a3786d8b3254b08811e3b2dd940b6b3e67c2c7faa449177e03692765d19d4f023', 'id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'created_at': datetime.datetime(2025, 9, 26, 16, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d65a9a1-65a8-426c-ba23-51a24bda4153/file', 'properties': {}}, 'image_service': } Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Cloning 05140ad3-f94e-484a-b109-eb6134d71ab1 from image 3d65a9a1-65a8-426c-ba23-51a24bda4153 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}]). {{(pid=83624) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c" returned: 0 in 0.481s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] <== create_volume: return (1058ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.954s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292214148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7faecb8-4d8e-4173-a419-797019b149a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8fb2d95a9ce425fabdf9ab696d1b70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:30Z,use_quota=True,user_id='01ee753a2ea74f23a747c9f9fb48aca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Creating volume a7faecb8-4d8e-4173-a419-797019b149a1 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:34 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:35 devstack quobyte-client[83627]: System call of process 100801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:35 devstack quobyte-client[83627]: System call of process 100801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:35 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=151, name=volume-a7faecb8-4d8e-4173-a419-797019b149a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:35 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9fc42442-055d-4022-b2a7-b541d63823fe tempest-CreateVolumesFromImageTest-1328921500 None] Created volume successfully. Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839d423b-fbd7-4666-b5c7-efc0b2ed1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261db5fd-93a5-448c-91f9-a86ef2416a5c', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f59336-17f3-471e-96cc-974cda719c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 26 18:03:35 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Image download 0.00 MB at 0.00 MB/s Sep 26 18:03:35 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Volume volume-261db5fd-93a5-448c-91f9-a86ef2416a5c (261db5fd-93a5-448c-91f9-a86ef2416a5c): created successfully Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f59336-17f3-471e-96cc-974cda719c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (118aed82-68a3-46a5-980c-ae1d37a87d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1 1073741824" returned: 0 in 0.629s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-1dd0b51b-0bcf-4aa5-8f6b-5ca5a0667d3e tempest-CreateVolumesFromImageTest-1328921500 None] Created volume successfully. Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ebc6df-3564-4ff6-99a2-1ebf6efb25f0]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1" returned: 0 in 0.835s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] <== create_volume: return (1523ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.070s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0c97a-6af2-4a1f-8460-74612105124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7faecb8-4d8e-4173-a419-797019b149a1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:36 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c8a5f7-ef3a-489e-bf60-3b36ff58a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:36 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating offline snapshot c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c of volume b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deaaaba-e5ad-4834-ae7d-e19077e5887d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:37 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Volume volume-a7faecb8-4d8e-4173-a419-797019b149a1 (a7faecb8-4d8e-4173-a419-797019b149a1): created successfully Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c8a5f7-ef3a-489e-bf60-3b36ff58a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Flow 'volume_create_manager' (25337dec-8b79-43c0-a55e-54953f1dd805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-a7faecb8-4d8e-4173-a419-797019b149a1-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:37 devstack quobyte-client[83627]: System call of process 100839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:37 devstack quobyte-client[83627]: System call of process 100839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:37 devstack quobyte-client[83627]: System call of process 100839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:37 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a8f1b044-4a39-4e15-b8e7-6e73ceae198b tempest-CreateVolumesFromImageTest-1328921500 None] Created volume successfully. Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159" returned: 0 in 0.763s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:37 devstack quobyte-client[83627]: System call of process 100842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:37 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-a7faecb8-4d8e-4173-a419-797019b149a1-delete_volume" acquired by "delete_volume" :: waited 0.281s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:37 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=152, name=volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c 1G" returned: 0 in 0.526s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:38 devstack quobyte-client[83627]: System call of process 100845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:38 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-quobyte-a7faecb8-4d8e-4173-a419-797019b149a1" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img rebase -u -b volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.605s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:03:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-a7faecb8-4d8e-4173-a419-797019b149a1" acquired by "delete_volume" :: waited 0.369s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a40bd-300d-4605-b61e-c4bafc3b1a89]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.506s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:39 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 0 in 3.298s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.263s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.info" returned: 0 in 0.180s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:39 devstack quobyte-client[83627]: System call of process 100851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:03:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1" returned: 0 in 0.798s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.info" returned: 0 in 0.244s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.626s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:40 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD Sep 26 18:03:40 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-a7faecb8-4d8e-4173-a419-797019b149a1" returned: 0 in 0.404s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-a7faecb8-4d8e-4173-a419-797019b149a1" released by "delete_volume" :: held 1.527s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:40 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-bac07aba-129d-4745-b713-2fbb1e8e85e8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Create snapshot completed successfully Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Created reservations ['f5c7ba7d-324c-4c7d-b95a-2de45a784de2', '00ac2446-4f76-462b-ac47-13216739d2a7', 'a086d40c-4fec-44bf-87d5-dab047217543', '7b39b463-5913-4fb9-a979-62bdad1ec204'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.135s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:41 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:41 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Deleted volume successfully. Sep 26 18:03:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-2edfbab2-94db-423e-89ce-85647dac9364 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-a7faecb8-4d8e-4173-a419-797019b149a1-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:42 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (59f56736-9a18-4b3a-a223-84f7cbad4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc169a2-5f82-4d78-be45-82d8b5f95874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-261db5fd-93a5-448c-91f9-a86ef2416a5c-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc169a2-5f82-4d78-be45-82d8b5f95874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090525874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4169cafb-fa0f-44de-b48f-660f3a3ce6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:42Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980ff2b-24b8-4000-9c5d-27dbd1ad6473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980ff2b-24b8-4000-9c5d-27dbd1ad6473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbe9adf-7c60-4a25-b578-a92c127713f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbe9adf-7c60-4a25-b578-a92c127713f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4169cafb-fa0f-44de-b48f-660f3a3ce6be', 'volume_name': 'volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351537b8-416f-4039-986e-5b3ffae320e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351537b8-416f-4039-986e-5b3ffae320e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858bb263-2812-4812-bc2d-66e06a63a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:42 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume 4169cafb-fa0f-44de-b48f-660f3a3ce6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be', 'volume_size': 1} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090525874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4169cafb-fa0f-44de-b48f-660f3a3ce6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:42Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume 4169cafb-fa0f-44de-b48f-660f3a3ce6be {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:42 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:42 devstack quobyte-client[83627]: System call of process 100867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:42 devstack quobyte-client[83627]: System call of process 100867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:42 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 26 18:03:42 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=154, name=volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-261db5fd-93a5-448c-91f9-a86ef2416a5c-delete_volume" acquired by "delete_volume" :: waited 0.710s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 1 in 3.493s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Temporary image 3d65a9a1-65a8-426c-ba23-51a24bda4153 is fetched for user 3f0648803f824c7ba5d2b5a7f625381f. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 26 18:03:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (d8cebff5-cc91-4773-96c0-86ef4a9e2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c593d67-bc1c-4303-9303-a520f2ff7a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be 1073741824" returned: 0 in 0.867s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c593d67-bc1c-4303-9303-a520f2ff7a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366080141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8329951d-1aba-46d7-90ee-9ae1ed2f9da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:42Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a34bdf-a6aa-4725-88e7-0f3644b9e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a34bdf-a6aa-4725-88e7-0f3644b9e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff88c6a-6149-466a-8a21-2487e7cb9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:43 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff88c6a-6149-466a-8a21-2487e7cb9e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8329951d-1aba-46d7-90ee-9ae1ed2f9da0', 'volume_name': 'volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c7f8be-d976-4ced-a328-9f0973c52bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c7f8be-d976-4ced-a328-9f0973c52bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a844d1-3def-48ee-a993-f4fb03e4d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume 8329951d-1aba-46d7-90ee-9ae1ed2f9da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0', 'volume_size': 1} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-quobyte-261db5fd-93a5-448c-91f9-a86ef2416a5c" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (121692c8-63b7-4a6e-be99-b7794cbc4790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deae7aa-6542-4474-8de2-dfff74e07d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be" returned: 0 in 0.862s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1775ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366080141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8329951d-1aba-46d7-90ee-9ae1ed2f9da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:42Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume 8329951d-1aba-46d7-90ee-9ae1ed2f9da0 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:44 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=155, name=volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858bb263-2812-4812-bc2d-66e06a63a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a7ac55-a937-4720-a883-3bcd18f88cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deae7aa-6542-4474-8de2-dfff74e07d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72638820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1617487f-caaf-49c6-9672-58e755941b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:43Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f064bc-2e2c-42d9-aece-815eff9cd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f064bc-2e2c-42d9-aece-815eff9cd00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22719baa-2bfe-49c7-a53b-b474e5bff635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22719baa-2bfe-49c7-a53b-b474e5bff635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1617487f-caaf-49c6-9672-58e755941b1a', 'volume_name': 'volume-1617487f-caaf-49c6-9672-58e755941b1a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519c44ff-961c-475b-ac1a-ae3c4c14fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519c44ff-961c-475b-ac1a-ae3c4c14fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785faaba-2ddb-41d6-bc89-63887cf4652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume 1617487f-caaf-49c6-9672-58e755941b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1617487f-caaf-49c6-9672-58e755941b1a', 'volume_size': 1} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (cbb395b4-ef20-491b-8e4f-2ec2f43d772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86853c5b-f5ea-481c-9fd0-a0799052ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-261db5fd-93a5-448c-91f9-a86ef2416a5c" acquired by "delete_volume" :: waited 0.816s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be (4169cafb-fa0f-44de-b48f-660f3a3ce6be): created successfully Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a7ac55-a937-4720-a883-3bcd18f88cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (59f56736-9a18-4b3a-a223-84f7cbad4327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (195984ff-1cef-41b7-8e40-9988acdc0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35db8bb1-6b60-4a82-adea-9cd62affd289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b71ad-4ccf-4212-b037-b154314a9223]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86853c5b-f5ea-481c-9fd0-a0799052ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900083718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160f43e4-6762-4105-a41d-7a455faff6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:44Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233ed77-3a55-4310-9f2e-ac81557ba7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2233ed77-3a55-4310-9f2e-ac81557ba7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0951af11-32b1-4bff-91b5-bdf5c24ba4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0951af11-32b1-4bff-91b5-bdf5c24ba4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160f43e4-6762-4105-a41d-7a455faff6a9', 'volume_name': 'volume-160f43e4-6762-4105-a41d-7a455faff6a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531c8907-9e54-499a-a34b-e2cb4b19c65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531c8907-9e54-499a-a34b-e2cb4b19c65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9902e61b-5606-4478-bb92-6f81f29bc0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume 160f43e4-6762-4105-a41d-7a455faff6a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160f43e4-6762-4105-a41d-7a455faff6a9', 'volume_size': 1} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449125e-198a-49f1-a7b6-2412fee13ae8]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 1073741824" returned: 0 in 1.217s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:45 devstack quobyte-client[83627]: System call of process 100874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:45 devstack quobyte-client[83627]: System call of process 100874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:45 devstack quobyte-client[83627]: System call of process 100874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35db8bb1-6b60-4a82-adea-9cd62affd289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705727565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ca625-a79f-4b28-b88f-7ce07b1289ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:44Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8af64c-ce29-43b9-9315-ceb80ee8ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8af64c-ce29-43b9-9315-ceb80ee8ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c5eb8a-2315-4544-acbe-92eb4d265562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c5eb8a-2315-4544-acbe-92eb4d265562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ca625-a79f-4b28-b88f-7ce07b1289ca', 'volume_name': 'volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff5acc7-1304-4a77-ac56-af9d724c89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff5acc7-1304-4a77-ac56-af9d724c89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21296f15-52e8-4d0b-bf07-6971a7b18a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume c45ca625-a79f-4b28-b88f-7ce07b1289ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca', 'volume_size': 1} Sep 26 18:03:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-53071f27-b881-4d3e-bac8-11f1f8e15aac tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:46 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD Sep 26 18:03:46 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c" returned: 0 in 1.058s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" returned: 0 in 0.491s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1974ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72638820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1617487f-caaf-49c6-9672-58e755941b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:43Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume 1617487f-caaf-49c6-9672-58e755941b1a {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:46 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:46 devstack quobyte-client[83627]: System call of process 100881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:46 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=156, name=volume-1617487f-caaf-49c6-9672-58e755941b1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a844d1-3def-48ee-a993-f4fb03e4d664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6acf832-72d2-4398-b08f-026e2fd31f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-261db5fd-93a5-448c-91f9-a86ef2416a5c" returned: 0 in 0.866s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:46 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 (8329951d-1aba-46d7-90ee-9ae1ed2f9da0): created successfully Sep 26 18:03:46 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6acf832-72d2-4398-b08f-026e2fd31f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (d8cebff5-cc91-4773-96c0-86ef4a9e2838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-261db5fd-93a5-448c-91f9-a86ef2416a5c" released by "delete_volume" :: held 2.179s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a 1073741824" returned: 0 in 0.643s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:47 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-84f59f9a-3678-4d84-85dd-0b7e52df2275 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a" returned: 0 in 0.480s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1175ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.328s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-900083718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160f43e4-6762-4105-a41d-7a455faff6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:44Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume 160f43e4-6762-4105-a41d-7a455faff6a9 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:47 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:47 devstack quobyte-client[83627]: System call of process 100887 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:47 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=157, name=volume-160f43e4-6762-4105-a41d-7a455faff6a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785faaba-2ddb-41d6-bc89-63887cf4652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1617487f-caaf-49c6-9672-58e755941b1a', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bd7463-2063-4a56-8c4a-6d23c76b427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9 1073741824" returned: 0 in 0.713s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:48 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 26 18:03:48 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-1617487f-caaf-49c6-9672-58e755941b1a (1617487f-caaf-49c6-9672-58e755941b1a): created successfully Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bd7463-2063-4a56-8c4a-6d23c76b427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (121692c8-63b7-4a6e-be99-b7794cbc4790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 0 in 3.355s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9" returned: 0 in 0.620s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1392ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705727565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ca625-a79f-4b28-b88f-7ce07b1289ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51161cfde354ef0968263857a9cab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:44Z,use_quota=True,user_id='6ec4aed233494059834c01283f877c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Creating volume c45ca625-a79f-4b28-b88f-7ce07b1289ca {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:49 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:49 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c0aaff7a-a6d4-41b1-a9a7-4c30e93916d6 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:49 devstack quobyte-client[83627]: System call of process 100892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:49 devstack quobyte-client[83627]: System call of process 100892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:49 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=158, name=volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:49 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD Sep 26 18:03:49 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Created reservations ['14fc523a-6d8e-4823-91fc-4666c6a47c9f', 'fb7dc21a-48b6-440c-9314-80bffa7b49d2', '5d0c6d58-1022-41ea-b10b-7348ca5b288f', '9a349052-9be4-42a9-a88e-e4e53c8f24ed'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9902e61b-5606-4478-bb92-6f81f29bc0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160f43e4-6762-4105-a41d-7a455faff6a9', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c927db-5c96-4247-b1dd-66dcbe027283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca 1073741824" returned: 0 in 0.664s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-f9bc5b35-3d76-44f1-9257-e14192904eee-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-160f43e4-6762-4105-a41d-7a455faff6a9 (160f43e4-6762-4105-a41d-7a455faff6a9): created successfully Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c927db-5c96-4247-b1dd-66dcbe027283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (cbb395b4-ef20-491b-8e4f-2ec2f43d772c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f9381fa0-46df-4bf9-b02c-a364e3d8c43f tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca" returned: 0 in 0.636s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] <== create_volume: return (1459ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.731s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-f9bc5b35-3d76-44f1-9257-e14192904eee-delete_volume" acquired by "delete_volume" :: waited 0.364s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Deleted volume successfully. Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21296f15-52e8-4d0b-bf07-6971a7b18a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcd5a0-6e71-4ff7-8341-298b5beccaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:50 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-quobyte-f9bc5b35-3d76-44f1-9257-e14192904eee" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:50 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca (c45ca625-a79f-4b28-b88f-7ce07b1289ca): created successfully Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcd5a0-6e71-4ff7-8341-298b5beccaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Flow 'volume_create_manager' (195984ff-1cef-41b7-8e40-9988acdc0950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c41ee943-f421-4d81-a873-4e1ea505e445 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-261db5fd-93a5-448c-91f9-a86ef2416a5c-delete_volume" released by "delete_volume" :: held 7.864s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-11e69b0c-a8d1-4ce9-a5ec-3fadfdb4bd3a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created volume successfully. Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-f9bc5b35-3d76-44f1-9257-e14192904eee" acquired by "delete_volume" :: waited 0.062s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba6a22-d136-4cfd-b198-4954344f8740]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-c45ca625-a79f-4b28-b88f-7ce07b1289ca-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-c45ca625-a79f-4b28-b88f-7ce07b1289ca-delete_volume" acquired by "delete_volume" :: waited 0.249s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:51 devstack quobyte-client[83627]: System call of process 100899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:51 devstack quobyte-client[83627]: System call of process 100899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:51 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 1 in 3.089s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05140ad3-f94e-484a-b109-eb6134d71ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b46d1bab4d81426390ce39db740aae16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:03:32Z,use_quota=True,user_id='3f0648803f824c7ba5d2b5a7f625381f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Creating volume 05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:03:52 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:52 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=159, name=volume-05140ad3-f94e-484a-b109-eb6134d71ab1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-c45ca625-a79f-4b28-b88f-7ce07b1289ca" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee" returned: 0 in 1.515s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 1073741824" returned: 0 in 0.597s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-c45ca625-a79f-4b28-b88f-7ce07b1289ca" acquired by "delete_volume" :: waited 0.354s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-f9bc5b35-3d76-44f1-9257-e14192904eee" returned: 0 in 0.343s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f7e61-de14-49b4-89a8-35be3d42d123]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 0 in 0.279s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-f9bc5b35-3d76-44f1-9257-e14192904eee" released by "delete_volume" :: held 2.122s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] <== create_volume: return (1159ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Attempting download of 3d65a9a1-65a8-426c-ba23-51a24bda4153 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}])) to volume 05140ad3-f94e-484a-b109-eb6134d71ab1. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 26 18:03:53 devstack quobyte-client[83627]: System call of process 100910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Created reservations ['820d28ea-9c5a-4cb2-9486-aa19209b33d8', '36b32cc0-f1bc-4d93-b5ee-64a085ffba93', 'bdd5ed81-57a0-42d7-9754-c0aea80d3201', 'b41eca65-e414-4328-9d67-2ec895730fd5'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca" returned: 0 in 0.629s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f50225e-9d10-4f93-a4f5-575f059e18a6]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d65a9a1-65a8-426c-ba23-51a24bda4153_ft4aq9ev {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c45ca625-a79f-4b28-b88f-7ce07b1289ca" returned: 0 in 0.640s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-c45ca625-a79f-4b28-b88f-7ce07b1289ca" released by "delete_volume" :: held 1.494s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d65a9a1-65a8-426c-ba23-51a24bda4153_ft4aq9ev" returned: 0 in 0.509s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d65a9a1-65a8-426c-ba23-51a24bda4153_ft4aq9ev {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-67d7f8db-a1f7-40f9-b172-00b3ea57cd49-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d65a9a1-65a8-426c-ba23-51a24bda4153_ft4aq9ev" returned: 1 in 0.814s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d65a9a1-65a8-426c-ba23-51a24bda4153_ft4aq9ev' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[142d0970-4a8f-4f75-9543-305ca1e32783]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-67d7f8db-a1f7-40f9-b172-00b3ea57cd49-delete_volume" acquired by "delete_volume" :: waited 0.252s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.493s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:55 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Deleted volume successfully. Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['280f7e01-09c9-4246-8f21-03b7b88d59fb', '3559d6c8-9847-4302-a4cf-39a36d8abea7', 'bd267bec-ffbf-4165-b08d-392826018df6', '3b9df914-d5b8-48f9-a778-eb34817e39f7'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 0 in 0.653s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-f95cd013-63b0-4698-9dec-c4e86b48940c tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-f9bc5b35-3d76-44f1-9257-e14192904eee-delete_volume" released by "delete_volume" :: held 5.418s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:56 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-quobyte-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD" returned: 1 in 0.593s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] 3d65a9a1-65a8-426c-ba23-51a24bda4153 was raw, converting to raw {{(pid=83624) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:56 devstack quobyte-client[83627]: System call of process 100925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:56 devstack quobyte-client[83627]: System call of process 100925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" acquired by "delete_volume" :: waited 0.205s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:56 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=159, name=volume-05140ad3-f94e-484a-b109-eb6134d71ab1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.499s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:03:56 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebfe777-4f27-47b1-a7a4-1061edcebff1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-160f43e4-6762-4105-a41d-7a455faff6a9-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 0 in 0.738s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d65a9a1-65a8-426c-ba23-51a24bda4153_ac9vex3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 18:03:57 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Converted 0.00 MB image at 0.00 MB/s Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:57 devstack quobyte-client[83627]: System call of process 100929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-a8c61572-5097-4379-897f-c3c56f552cee tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-c45ca625-a79f-4b28-b88f-7ce07b1289ca-delete_volume" released by "delete_volume" :: held 5.700s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:57 devstack quobyte-client[83627]: System call of process 100928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:57 devstack quobyte-client[83627]: System call of process 100928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 1G" returned: 0 in 0.298s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-160f43e4-6762-4105-a41d-7a455faff6a9-delete_volume" acquired by "delete_volume" :: waited 0.386s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[005405e4-a6f6-4353-8dd9-330d2fcb74cd]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:57 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" returned: 0 in 1.117s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:58 devstack quobyte-client[83627]: System call of process 100934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:58 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-160f43e4-6762-4105-a41d-7a455faff6a9" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" returned: 0 in 0.455s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 0 in 0.779s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-67d7f8db-a1f7-40f9-b172-00b3ea57cd49" released by "delete_volume" :: held 2.089s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-160f43e4-6762-4105-a41d-7a455faff6a9" acquired by "delete_volume" :: waited 0.361s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee72284-7f88-4c16-a2ff-561024165d7b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:03:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:59 devstack quobyte-client[83627]: System call of process 100937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:59 devstack quobyte-client[83627]: System call of process 100937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:59 devstack quobyte-client[83627]: System call of process 100937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 1 in 0.721s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Downloaded image 3d65a9a1-65a8-426c-ba23-51a24bda4153 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}])) to volume 05140ad3-f94e-484a-b109-eb6134d71ab1 successfully. {{(pid=83624) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Temporary image 3d65a9a1-65a8-426c-ba23-51a24bda4153 for user 3f0648803f824c7ba5d2b5a7f625381f is deleted. {{(pid=83624) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.volume_utils [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Marking volume 05140ad3-f94e-484a-b109-eb6134d71ab1 as bootable. {{(pid=83624) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Copying metadata from image 3d65a9a1-65a8-426c-ba23-51a24bda4153 to 05140ad3-f94e-484a-b109-eb6134d71ab1. {{(pid=83624) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Creating volume glance metadata for volume 05140ad3-f94e-484a-b109-eb6134d71ab1 backed by image 3d65a9a1-65a8-426c-ba23-51a24bda4153 with: {'image_id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2b7b2d901b713f8e905a71ebf0b10ae3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83624) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Created reservations ['6d7ac95f-f622-4603-a622-3f79d4242eab', '41760d53-dac4-4c8a-9175-a38a77d75c2e', '20153d9f-c711-499a-8893-ad54070aaba3', '92706010-803e-43b1-a820-5d5f0647c74b'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e918d-3072-427c-b2f7-ba481ab406e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05140ad3-f94e-484a-b109-eb6134d71ab1', 'volume_size': 1, 'image_id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d65a9a1-65a8-426c-ba23-51a24bda4153', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b7b2d901b713f8e905a71ebf0b10ae3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b46d1bab4d81426390ce39db740aae16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a91d2987350041930ab993bf2d1989cf8d4e5f6c9d9ccdb5046304bfdcfcd8a3786d8b3254b08811e3b2dd940b6b3e67c2c7faa449177e03692765d19d4f023', 'id': '3d65a9a1-65a8-426c-ba23-51a24bda4153', 'created_at': datetime.datetime(2025, 9, 26, 16, 3, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 26, 16, 3, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d65a9a1-65a8-426c-ba23-51a24bda4153/file', 'properties': {}}, 'image_service': }' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d67b50-cd73-4058-850e-133df7d553fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9" returned: 0 in 0.714s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:03:59 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Volume volume-05140ad3-f94e-484a-b109-eb6134d71ab1 (05140ad3-f94e-484a-b109-eb6134d71ab1): created successfully Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d67b50-cd73-4058-850e-133df7d553fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:03:59 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Flow 'volume_create_manager' (3cbf94fd-4b2a-45cf-8149-f7231c3720f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-160f43e4-6762-4105-a41d-7a455faff6a9" returned: 0 in 0.377s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8075b869-b760-4a12-a825-615036f30b2a tempest-VolumeImageDependencyTests-938581300 None] Created volume successfully. Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-160f43e4-6762-4105-a41d-7a455faff6a9" released by "delete_volume" :: held 1.476s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-babb00a1-1cc0-44c5-b018-64e8922828cf-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Acquiring lock "cinder-05140ad3-f94e-484a-b109-eb6134d71ab1-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.574s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-babb00a1-1cc0-44c5-b018-64e8922828cf-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Deleted volume successfully. Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "cinder-05140ad3-f94e-484a-b109-eb6134d71ab1-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:00 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Acquiring lock "cinder-quobyte-05140ad3-f94e-484a-b109-eb6134d71ab1" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:00 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['7334ebdd-0331-49d7-b3c5-8c8d4c9e3104', '436d4187-f84e-455f-8c02-d573cc16bc79', 'ff811b11-8245-483a-8c84-69f720c67ece', '7c29fd48-e7af-4595-8121-75d31c077e80'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "cinder-quobyte-babb00a1-1cc0-44c5-b018-64e8922828cf" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-9b1de528-e31f-419f-aa4a-601448fe3dae tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-67d7f8db-a1f7-40f9-b172-00b3ea57cd49-delete_volume" released by "delete_volume" :: held 5.776s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "cinder-quobyte-05140ad3-f94e-484a-b109-eb6134d71ab1" acquired by "delete_volume" :: waited 0.073s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-babb00a1-1cc0-44c5-b018-64e8922828cf" acquired by "delete_volume" :: waited 0.041s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d797cf-975a-408e-8c42-619430556d31]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[9724aba8-b1bf-47c1-a3ef-1951e7980271]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:01 devstack quobyte-client[83627]: System call of process 100948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:01 devstack quobyte-client[83627]: System call of process 100948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:01 devstack quobyte-client[83627]: System call of process 100948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:01 devstack quobyte-client[83627]: System call of process 100948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.293s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:01 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-1617487f-caaf-49c6-9672-58e755941b1a-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:02 devstack quobyte-client[83627]: System call of process 100949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:02 devstack quobyte-client[83627]: System call of process 100949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:02 devstack quobyte-client[83627]: System call of process 100949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:02 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 0 in 1.092s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf" returned: 0 in 1.279s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-1617487f-caaf-49c6-9672-58e755941b1a-delete_volume" acquired by "delete_volume" :: waited 0.613s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-944d5a4f-d018-434b-a56a-16d950af899b tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-160f43e4-6762-4105-a41d-7a455faff6a9-delete_volume" released by "delete_volume" :: held 5.152s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-babb00a1-1cc0-44c5-b018-64e8922828cf" returned: 0 in 0.422s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 1 in 0.728s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1' failed. Not Retrying. {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 26 18:04:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-1617487f-caaf-49c6-9672-58e755941b1a" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-quobyte-babb00a1-1cc0-44c5-b018-64e8922828cf" released by "delete_volume" :: held 2.314s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-05140ad3-f94e-484a-b109-eb6134d71ab1" returned: 0 in 0.434s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "cinder-quobyte-05140ad3-f94e-484a-b109-eb6134d71ab1" released by "delete_volume" :: held 2.379s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-1617487f-caaf-49c6-9672-58e755941b1a" acquired by "delete_volume" :: waited 0.089s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[527acc76-6f77-4fb5-947f-386f3b23e2a3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:03 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Created reservations ['37341514-0e95-48ab-9da2-5469c3253224', '04e8af8a-236a-4fb6-bce7-18ed35695ca1', '443e6caa-7a54-4ca1-a9c1-62845bd7bc1c', 'abc8e356-b6fc-4cd2-95ac-22957569f19f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:04 devstack quobyte-client[83627]: System call of process 100965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:04 devstack quobyte-client[83627]: System call of process 100965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Created reservations ['f50ab92f-cdc3-4c5f-96cc-ca7c31f9cc93', '84c10d0b-0d62-4d8b-9a81-b95abda93138', 'a4437023-26c7-42ea-98a0-7939b06bea55', '798af00c-1271-4cb1-9247-aff43a02b770'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a" returned: 0 in 0.658s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-1617487f-caaf-49c6-9672-58e755941b1a" returned: 0 in 0.582s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.507s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:05 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Deleted volume successfully. Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-1617487f-caaf-49c6-9672-58e755941b1a" released by "delete_volume" :: held 1.828s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.520s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:05 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Deleted volume successfully. Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e1915ad7-8b75-4ea2-94ac-669d9b160ded tempest-VolumeImageDependencyTests-938581300 None] Lock "cinder-05140ad3-f94e-484a-b109-eb6134d71ab1-delete_volume" released by "delete_volume" :: held 4.558s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-230e061b-5411-4e87-8e9e-d3c686a9ec35 tempest-CreateVolumesFromImageTest-1328921500 None] Lock "cinder-babb00a1-1cc0-44c5-b018-64e8922828cf-delete_volume" released by "delete_volume" :: held 4.732s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['da51c151-ff7a-46f6-8095-753532d20f4b', '7422d2f6-ab1d-4425-8eda-babb325370bb', '5b9e3195-9cff-4d2b-89bd-b5ef51e5697b', '9bb957c8-b5e3-4542-abcb-ed94a03c0b74'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.174s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:06 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-0aa71989-c3b1-4270-85db-af4eedafae0a tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-1617487f-caaf-49c6-9672-58e755941b1a-delete_volume" released by "delete_volume" :: held 3.719s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-8329951d-1aba-46d7-90ee-9ae1ed2f9da0-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-8329951d-1aba-46d7-90ee-9ae1ed2f9da0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:06 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fef6e0d-9b3f-478e-bd55-31a9b1ceb99f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:07 devstack quobyte-client[83627]: System call of process 100974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" returned: 0 in 0.534s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" returned: 0 in 0.143s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-8329951d-1aba-46d7-90ee-9ae1ed2f9da0" released by "delete_volume" :: held 0.922s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['7ba100c8-2ce6-4b99-af7b-5b263024d76a', '66180319-62a0-4ed7-9640-4082fc22d2b6', '8b87750d-9dff-410c-a27c-19608fd24147', 'c3af68a6-668c-4a91-a0c4-084cbfdc933a'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.124s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:08 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:04:08 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6c0a3309-f644-43c5-a7ca-30be079122b5 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-8329951d-1aba-46d7-90ee-9ae1ed2f9da0-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-4169cafb-fa0f-44de-b48f-660f3a3ce6be-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-4169cafb-fa0f-44de-b48f-660f3a3ce6be-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:09 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-4169cafb-fa0f-44de-b48f-660f3a3ce6be" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-4169cafb-fa0f-44de-b48f-660f3a3ce6be" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d5f91-4772-4d97-9f3a-845fe68a6de5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be" returned: 0 in 0.960s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:10 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Flow 'volume_create_manager' (68eee075-9be9-4c20-a13d-a412ed879330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0719c0e-4729-4372-a449-58f7df7e7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.907s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0719c0e-4729-4372-a449-58f7df7e7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68f389f-f268-49ad-8163-5d91076a70e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58736a790d234a599337e1871797d60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:10Z,use_quota=True,user_id='f5f94d8b5ead4ca386e8711ab67b6012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7a16a0-0b10-432b-b22c-ef26be2c9a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7a16a0-0b10-432b-b22c-ef26be2c9a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffd0468-9b19-422b-960c-7883593edecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffd0468-9b19-422b-960c-7883593edecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68f389f-f268-49ad-8163-5d91076a70e1', 'volume_name': 'volume-c68f389f-f268-49ad-8163-5d91076a70e1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da038aa-64cd-4a42-ac77-008344775f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da038aa-64cd-4a42-ac77-008344775f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60665d9a-9ca5-4aee-b785-fcafc0da3afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:10 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Volume c68f389f-f268-49ad-8163-5d91076a70e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68f389f-f268-49ad-8163-5d91076a70e1', 'volume_size': 1} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68f389f-f268-49ad-8163-5d91076a70e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58736a790d234a599337e1871797d60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:10Z,use_quota=True,user_id='f5f94d8b5ead4ca386e8711ab67b6012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Creating volume c68f389f-f268-49ad-8163-5d91076a70e1 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:10 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:11 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=160, name=volume-c68f389f-f268-49ad-8163-5d91076a70e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4169cafb-fa0f-44de-b48f-660f3a3ce6be" returned: 0 in 0.913s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-4169cafb-fa0f-44de-b48f-660f3a3ce6be" released by "delete_volume" :: held 2.080s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1 1073741824" returned: 0 in 0.553s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1" returned: 0 in 0.301s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:11 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60665d9a-9ca5-4aee-b785-fcafc0da3afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68f389f-f268-49ad-8163-5d91076a70e1', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0eb76e-38de-4581-ac6a-7db6bd342085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:12 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Volume volume-c68f389f-f268-49ad-8163-5d91076a70e1 (c68f389f-f268-49ad-8163-5d91076a70e1): created successfully Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0eb76e-38de-4581-ac6a-7db6bd342085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Flow 'volume_create_manager' (68eee075-9be9-4c20-a13d-a412ed879330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['ec8dcecf-e9ba-49d9-bdc7-65cf1cbe6bd8', 'e2ac74a2-7dcb-4c7d-a61f-584de5efaaaa', '8cb582f9-5fe9-4818-851c-0250ecb8e8fb', '5c2cc061-44bd-41d8-b1de-20d59c27bde4'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:12 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8d64ee9a-5b86-40c1-ad8b-c024ebcf1031 tempest-CinderUnicodeTest-105885354 None] Created volume successfully. Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.156s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:12 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.179s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:12 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-693b9969-02ea-4677-8b93-cb94f843924e tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-4169cafb-fa0f-44de-b48f-660f3a3ce6be-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleting offline snapshot c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c of volume b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] snapshot_file for this snap is: volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ccbd8-da5e-4f51-8739-6bfc7d690618]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:12 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.481s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:13 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:04:13 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b8622-322a-4e19-a203-27eb1ff67006]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:13 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:14 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Flow 'volume_create_manager' (7ad1fcf8-d6f2-4e08-8cb8-e3ca3c0e0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c921b0-d87a-474b-9d9c-490f0493f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159" returned: 0 in 0.829s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c921b0-d87a-474b-9d9c-490f0493f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-888495214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c962ac65-e33b-4d07-a275-fd7a9aa7d98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58736a790d234a599337e1871797d60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:14Z,use_quota=True,user_id='f5f94d8b5ead4ca386e8711ab67b6012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05af79f-5089-471b-b8f4-94a474368bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05af79f-5089-471b-b8f4-94a474368bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c002ea-a839-4d0c-9f94-b6fcc4c6c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c002ea-a839-4d0c-9f94-b6fcc4c6c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c962ac65-e33b-4d07-a275-fd7a9aa7d98f', 'volume_name': 'volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518f5e7a-bc95-4353-9ba1-57c96fc12e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518f5e7a-bc95-4353-9ba1-57c96fc12e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e1c0bf-174c-4bca-8c41-f3a817df43b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:14 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Volume c962ac65-e33b-4d07-a275-fd7a9aa7d98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f', 'volume_size': 1} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-888495214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c962ac65-e33b-4d07-a275-fd7a9aa7d98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58736a790d234a599337e1871797d60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:14Z,use_quota=True,user_id='f5f94d8b5ead4ca386e8711ab67b6012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Creating volume c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:14 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack quobyte-client[83627]: System call of process 100999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:14 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.633s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:15 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=161, name=volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159.c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" returned: 0 in 0.191s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c" released by "_delete_snapshot" :: held 2.619s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f 1073741824" returned: 0 in 0.674s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:15 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" released by "delete_snapshot" :: held 2.850s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" returned: 0 in 0.653s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] <== create_volume: return (1385ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e1c0bf-174c-4bca-8c41-f3a817df43b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208ace3b-8f0d-4fa8-a13d-83ba9b356f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:16 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Volume volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f (c962ac65-e33b-4d07-a275-fd7a9aa7d98f): created successfully Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208ace3b-8f0d-4fa8-a13d-83ba9b356f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Flow 'volume_create_manager' (7ad1fcf8-d6f2-4e08-8cb8-e3ca3c0e0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-b1b4009d-9170-4a7b-b243-982b2776446e tempest-CinderUnicodeTest-105885354 None] Created volume successfully. Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['5b84ee1a-fb25-4b13-96ed-1122f61c87b5', 'f3b9d678-739b-4ff8-ac6e-483d193948f5', '55f639b9-fc8e-4099-9891-c5e0209dfeb3', '737993ee-b79c-4970-acbb-48699e06ad61'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:16 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Delete snapshot completed successfully. Sep 26 18:04:16 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-8d4d090f-c07a-4d5a-b581-318da88ee9d8 tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-c686dd6f-d84b-4f7e-b877-8e88c6f6ad5c-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-b4e4ec06-eba0-48d1-adbd-92c61af6c159-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-b4e4ec06-eba0-48d1-adbd-92c61af6c159-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:17 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80877ed-af7c-4bb6-9fd8-40154b80005b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:17 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:18 devstack quobyte-client[83627]: System call of process 101005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:18 devstack quobyte-client[83627]: System call of process 101005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159" returned: 0 in 0.978s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:18 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:18 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b4e4ec06-eba0-48d1-adbd-92c61af6c159" returned: 0 in 0.712s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Creating offline snapshot 92432ff2-9d4f-4407-b212-cabdae64cc88 of volume c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-quobyte-b4e4ec06-eba0-48d1-adbd-92c61af6c159" released by "delete_volume" :: held 1.927s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d2cf4-9714-46a7-9706-ec5eda7e1c83]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Created reservations ['91ddf5ee-3737-47b6-9eec-43904bf15979', '8d0dbc44-182c-447f-873f-30b771647c02', '2a02f2d6-0e4b-4729-b2e6-3fbd7c00966d', '441e6bae-1db6-46fc-9af2-d12fb050b20e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:19 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" returned: 0 in 0.802s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.322s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:20 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Deleted volume successfully. Sep 26 18:04:20 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=162, name=volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=83,cinder:UPDATE=123,cinder:DELETE=17,cinder:INSERT=22 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 1G" returned: 0 in 0.571s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:20 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:21 devstack quobyte-client[83627]: System call of process 101019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:21 devstack quobyte-client[83627]: System call of process 101019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "qemu-img rebase -u -b volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.481s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d948df1d-2ac3-4a6e-8e96-94b7f5dc28bd tempest-CreateVolumesFromSnapshotTest-1389890286 None] Lock "cinder-b4e4ec06-eba0-48d1-adbd-92c61af6c159-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.382s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 18:04:21 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.383s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.info" returned: 0 in 0.232s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.info" returned: 0 in 0.220s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:22 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:23 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=91,cinder:UPDATE=144,cinder:DELETE=10,cinder:INSERT=39 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:04:23 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-eb9f4a38-1ae2-4de7-a779-d4e7f9fe480d tempest-CinderUnicodeTest-105885354 None] Create snapshot completed successfully Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-92432ff2-9d4f-4407-b212-cabdae64cc88-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-92432ff2-9d4f-4407-b212-cabdae64cc88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:24 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-quobyte-92432ff2-9d4f-4407-b212-cabdae64cc88" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-92432ff2-9d4f-4407-b212-cabdae64cc88" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Deleting offline snapshot 92432ff2-9d4f-4407-b212-cabdae64cc88 of volume c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] snapshot_file for this snap is: volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da5ab1-199f-4673-9e6d-e224eb80cd3e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:24 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:25 devstack quobyte-client[83627]: System call of process 101026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:25 devstack quobyte-client[83627]: System call of process 101026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:25 devstack quobyte-client[83627]: System call of process 101026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:25 devstack quobyte-client[83627]: System call of process 101026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.937s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:04:25 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (1fda42c2-dc2b-48b1-a3c3-81980c714731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8cc557-749e-449d-b494-7d8c96428758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2766bd-82af-4511-828c-09ca8da4c429]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:25 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8cc557-749e-449d-b494-7d8c96428758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58701193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b159b6d1-5c92-4035-91bb-8368b67cd604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:25Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5caa8ba-3326-44a6-9565-a80c572e9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5caa8ba-3326-44a6-9565-a80c572e9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6fa93a-5f39-475e-9b67-985fb4050f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6fa93a-5f39-475e-9b67-985fb4050f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b159b6d1-5c92-4035-91bb-8368b67cd604', 'volume_name': 'volume-b159b6d1-5c92-4035-91bb-8368b67cd604', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea9f441-3a11-4b6b-ba21-77eefb043a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea9f441-3a11-4b6b-ba21-77eefb043a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e787c01-f128-4204-a0b1-1908ec742b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:26 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume b159b6d1-5c92-4035-91bb-8368b67cd604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b159b6d1-5c92-4035-91bb-8368b67cd604', 'volume_size': 1} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58701193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b159b6d1-5c92-4035-91bb-8368b67cd604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:25Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume b159b6d1-5c92-4035-91bb-8368b67cd604 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:26 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:26 devstack quobyte-client[83627]: System call of process 101030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:26 devstack quobyte-client[83627]: System call of process 101030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" returned: 0 in 0.691s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:26 devstack quobyte-client[83627]: System call of process 101030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:26 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=164, name=volume-b159b6d1-5c92-4035-91bb-8368b67cd604, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:26 devstack quobyte-client[83627]: System call of process 101035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:26 devstack quobyte-client[83627]: System call of process 101035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604 1073741824" returned: 0 in 0.512s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:26 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.377s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604" returned: 0 in 0.219s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e787c01-f128-4204-a0b1-1908ec742b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b159b6d1-5c92-4035-91bb-8368b67cd604', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38598df4-8a5d-468f-92d5-adb6607e8c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f.92432ff2-9d4f-4407-b212-cabdae64cc88" returned: 0 in 0.445s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-92432ff2-9d4f-4407-b212-cabdae64cc88" released by "_delete_snapshot" :: held 3.126s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:27 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-b159b6d1-5c92-4035-91bb-8368b67cd604 (b159b6d1-5c92-4035-91bb-8368b67cd604): created successfully Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38598df4-8a5d-468f-92d5-adb6607e8c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (1fda42c2-dc2b-48b1-a3c3-81980c714731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" released by "delete_snapshot" :: held 3.185s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:27 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-9268147e-646d-469e-8dde-87ce741875af tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:27 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Created reservations ['a792fc48-dd28-416b-bffa-4ed718809114', 'c2604a61-7734-4505-8968-0e049b3186b3', '12fbe96b-178c-490e-9257-062cdc4736af', 'a12d5571-2641-480e-88e9-1740e6a8769f'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:28 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Delete snapshot completed successfully. Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-67c40c4f-e872-4760-b29c-57142bc63ad1 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-92432ff2-9d4f-4407-b212-cabdae64cc88-delete_snapshot" released by "delete_snapshot" :: held 3.560s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-c962ac65-e33b-4d07-a275-fd7a9aa7d98f-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-c962ac65-e33b-4d07-a275-fd7a9aa7d98f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:28 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" acquired by "delete_volume" :: waited 0.021s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce62e05-9884-4d02-be40-0e026dff02c6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:28 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:29 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (34975bb5-ed4f-4620-9faf-1d1a76cd0970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df23bd8-07ae-4877-8966-59c7c56846d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df23bd8-07ae-4877-8966-59c7c56846d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175477435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d26f5c-b341-47ca-b8ab-74187d9b4067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:29Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72334f4e-95b1-4286-9f9a-33050fcdf5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72334f4e-95b1-4286-9f9a-33050fcdf5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698f065-77e3-4fb1-96ed-a4fac4ea76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698f065-77e3-4fb1-96ed-a4fac4ea76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d26f5c-b341-47ca-b8ab-74187d9b4067', 'volume_name': 'volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91b2cbe-d5f6-42ec-955e-507000e99c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91b2cbe-d5f6-42ec-955e-507000e99c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a85659-eb13-4f93-b988-4d1ddd604f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:29 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume e7d26f5c-b341-47ca-b8ab-74187d9b4067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067', 'volume_size': 1} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175477435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d26f5c-b341-47ca-b8ab-74187d9b4067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:29Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume e7d26f5c-b341-47ca-b8ab-74187d9b4067 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:29 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:29 devstack quobyte-client[83627]: System call of process 101040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:29 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:30 devstack quobyte-client[83627]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:30 devstack quobyte-client[83627]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:30 devstack quobyte-client[83627]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:30 devstack quobyte-client[83627]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:30 devstack quobyte-client[83627]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:30 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=165, name=volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 1073741824" returned: 0 in 0.765s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" returned: 0 in 1.645s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:30 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:31 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (af4bc88e-1fcd-49b3-ac9c-87ef472ea533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41066e-bf50-4ed4-91ff-d911ecd98418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (74342e8d-b809-4a79-9f46-01ab7acbb039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6825d8-af43-4106-9fda-aa0fca4f1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067" returned: 0 in 1.078s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f41066e-bf50-4ed4-91ff-d911ecd98418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791189970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:30Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabde75-2d89-42a9-a7e8-a70a99795888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabde75-2d89-42a9-a7e8-a70a99795888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aefdd1-9ef5-4ed4-9c4a-14d603f9de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aefdd1-9ef5-4ed4-9c4a-14d603f9de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac', 'volume_name': 'volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0d3ec7-40d9-4194-b107-a1af14e26e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0d3ec7-40d9-4194-b107-a1af14e26e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf3a1e3-826d-42c5-96df-cad4075f8281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:31 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume 2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac', 'volume_size': 1} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (1978ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" returned: 0 in 1.088s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791189970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:30Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume 2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:31 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:31 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:31 devstack quobyte-client[83627]: System call of process 101049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:31 devstack quobyte-client[83627]: System call of process 101049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:31 devstack quobyte-client[83627]: System call of process 101049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:31 devstack quobyte-client[83627]: System call of process 101049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:31 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=166, name=volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6825d8-af43-4106-9fda-aa0fca4f1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172070030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf30bc-fe79-45bd-9bca-498305879df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:30Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21204cc-29f7-46a8-872f-e2fd4c90edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21204cc-29f7-46a8-872f-e2fd4c90edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d246d6-18c8-4f6a-895c-80e10d890d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d246d6-18c8-4f6a-895c-80e10d890d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddf30bc-fe79-45bd-9bca-498305879df5', 'volume_name': 'volume-4ddf30bc-fe79-45bd-9bca-498305879df5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b259b21b-3dfb-4ad5-a2d2-079e9343a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b259b21b-3dfb-4ad5-a2d2-079e9343a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bf0e0e-4880-4f1f-a0d2-081260a69c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume 4ddf30bc-fe79-45bd-9bca-498305879df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddf30bc-fe79-45bd-9bca-498305879df5', 'volume_size': 1} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c962ac65-e33b-4d07-a275-fd7a9aa7d98f" released by "delete_volume" :: held 3.576s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (5b5bd849-15c1-4291-af60-de578d8739b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b3a01-dbb6-478b-9047-2d3c6c481035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b3a01-dbb6-478b-9047-2d3c6c481035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802136272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2e4bad-6457-4897-a820-146698f41c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:31Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d689ac9-7dbf-4ee3-824d-984a1d9fd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d689ac9-7dbf-4ee3-824d-984a1d9fd880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a52a8-2a49-41ab-be6e-e4260f14e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a52a8-2a49-41ab-be6e-e4260f14e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2e4bad-6457-4897-a820-146698f41c37', 'volume_name': 'volume-4b2e4bad-6457-4897-a820-146698f41c37', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da5cb1-cd98-4d5b-8c59-3a66271d6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da5cb1-cd98-4d5b-8c59-3a66271d6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4faedec7-9fc1-4353-be89-53437f5288d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume 4b2e4bad-6457-4897-a820-146698f41c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2e4bad-6457-4897-a820-146698f41c37', 'volume_size': 1} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a85659-eb13-4f93-b988-4d1ddd604f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62e2f49-f857-4a0c-bb48-c3d1c0556033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (7db238ee-0ebb-4257-8960-c0b4c9e73fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83043246-b639-436e-9cb4-3187b3e28ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:32 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 (e7d26f5c-b341-47ca-b8ab-74187d9b4067): created successfully Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62e2f49-f857-4a0c-bb48-c3d1c0556033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (34975bb5-ed4f-4620-9faf-1d1a76cd0970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac 1073741824" returned: 0 in 0.946s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:32 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:33 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-20df3f0b-8286-40ee-b99c-63fb5798023d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83043246-b639-436e-9cb4-3187b3e28ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055369128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f74bd-60cc-45bd-a1ca-94e8d265c242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:32Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedb47a5-04c0-4635-a08e-9849cb8b1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedb47a5-04c0-4635-a08e-9849cb8b1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d0558-29b9-4ae3-a1b1-f3cebfdb4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d0558-29b9-4ae3-a1b1-f3cebfdb4482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243f74bd-60cc-45bd-a1ca-94e8d265c242', 'volume_name': 'volume-243f74bd-60cc-45bd-a1ca-94e8d265c242', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db78ee51-9531-49e6-a9d2-77dcef96f3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db78ee51-9531-49e6-a9d2-77dcef96f3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c533bfa1-1ecb-457d-9655-712ef3c4123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:33 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume 243f74bd-60cc-45bd-a1ca-94e8d265c242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243f74bd-60cc-45bd-a1ca-94e8d265c242', 'volume_size': 1} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" returned: 0 in 0.503s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (1525ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172070030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf30bc-fe79-45bd-9bca-498305879df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:30Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume 4ddf30bc-fe79-45bd-9bca-498305879df5 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:33 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:33 devstack quobyte-client[83627]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:33 devstack quobyte-client[83627]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:33 devstack quobyte-client[83627]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:33 devstack quobyte-client[83627]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:33 devstack quobyte-client[83627]: System call of process 101053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:33 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=167, name=volume-4ddf30bc-fe79-45bd-9bca-498305879df5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Created reservations ['d657499b-82e1-4a4c-821b-1653ed009039', '5bd19480-2a41-4b4d-986e-45b6754231ad', '951e9f34-4cb2-4c96-a868-bac85c403bae', '0d4213fe-8d57-4a1f-97d9-89737c94edfd'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf3a1e3-826d-42c5-96df-cad4075f8281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9636c16-1f79-466d-8f79-3f0ae69e1d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5 1073741824" returned: 0 in 0.557s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:33 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:34 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac (2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac): created successfully Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9636c16-1f79-466d-8f79-3f0ae69e1d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (af4bc88e-1fcd-49b3-ac9c-87ef472ea533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-c68f389f-f268-49ad-8163-5d91076a70e1-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:34 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-eadaf0f5-1057-4836-a441-0c1640c93e53 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5" returned: 0 in 0.756s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (1368ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1802136272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2e4bad-6457-4897-a820-146698f41c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:31Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume 4b2e4bad-6457-4897-a820-146698f41c37 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:34 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:34 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:34 devstack quobyte-client[83627]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:34 devstack quobyte-client[83627]: System call of process 101057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:34 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=168, name=volume-4b2e4bad-6457-4897-a820-146698f41c37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-c68f389f-f268-49ad-8163-5d91076a70e1-delete_volume" acquired by "delete_volume" :: waited 0.574s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bf0e0e-4880-4f1f-a0d2-081260a69c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddf30bc-fe79-45bd-9bca-498305879df5', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49708fd0-c5b9-4ea6-aa55-3b83ac0e8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37 1073741824" returned: 0 in 1.086s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:35 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "cinder-quobyte-c68f389f-f268-49ad-8163-5d91076a70e1" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:35 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:36 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-4ddf30bc-fe79-45bd-9bca-498305879df5 (4ddf30bc-fe79-45bd-9bca-498305879df5): created successfully Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49708fd0-c5b9-4ea6-aa55-3b83ac0e8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (74342e8d-b809-4a79-9f46-01ab7acbb039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.919s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37" returned: 0 in 0.478s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Deleted volume successfully. Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (1644ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:36 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e47d1156-097d-43dd-85c0-a41a4ecf8671 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c68f389f-f268-49ad-8163-5d91076a70e1" acquired by "delete_volume" :: waited 0.548s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.143s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055369128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243f74bd-60cc-45bd-a1ca-94e8d265c242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ad7ac3322942748506d96502ac3c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:32Z,use_quota=True,user_id='e280a339865c43429534ae0341bbef2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Creating volume 243f74bd-60cc-45bd-a1ca-94e8d265c242 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:36 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:36 devstack quobyte-client[83627]: System call of process 101062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:36 devstack quobyte-client[83627]: System call of process 101062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:36 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=169, name=volume-243f74bd-60cc-45bd-a1ca-94e8d265c242, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ac68a-0014-4862-bcc3-f772ab6c0c7f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:36 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4faedec7-9fc1-4353-be89-53437f5288d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2e4bad-6457-4897-a820-146698f41c37', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cdb7b2-8501-4e6a-9ad5-1e677d81f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:37 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-4b2e4bad-6457-4897-a820-146698f41c37 (4b2e4bad-6457-4897-a820-146698f41c37): created successfully Sep 26 18:04:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cdb7b2-8501-4e6a-9ad5-1e677d81f404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:37 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (5b5bd849-15c1-4291-af60-de578d8739b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:38 devstack quobyte-client[83627]: System call of process 101072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-4c28683b-94a5-491c-91ed-ba59f0598de4 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-c962ac65-e33b-4d07-a275-fd7a9aa7d98f-delete_volume" released by "delete_volume" :: held 9.418s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 1073741824" returned: 0 in 1.778s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:38 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-fc40dab6-6b18-45b1-a41c-c87df81143c7 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1" returned: 0 in 1.841s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242" returned: 0 in 0.608s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] <== create_volume: return (2498ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:38 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-c68f389f-f268-49ad-8163-5d91076a70e1" returned: 0 in 0.424s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c533bfa1-1ecb-457d-9655-712ef3c4123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243f74bd-60cc-45bd-a1ca-94e8d265c242', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6599e-5472-4c51-9a2c-ff2b76f4aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-quobyte-c68f389f-f268-49ad-8163-5d91076a70e1" released by "delete_volume" :: held 2.737s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:39 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 (243f74bd-60cc-45bd-a1ca-94e8d265c242): created successfully Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6599e-5472-4c51-9a2c-ff2b76f4aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Flow 'volume_create_manager' (7db238ee-0ebb-4257-8960-c0b4c9e73fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:39 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e9e5a41d-afc0-4a0a-a366-264d0ee4f120 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created volume successfully. Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Created reservations ['73e9e329-d13f-48e0-bd08-6c5a676606a3', '7ff47aeb-b601-4777-ad70-c54e452516c6', '1217b9c5-a856-4a11-96a8-e1a030719a0e', '02d5eadd-a07c-431d-88cb-2ea2134912a1'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.115s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:39 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:39 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Deleted volume successfully. Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-e8dda0a8-4c5a-4ad7-94e2-9b8f76f0c2d2 tempest-CinderUnicodeTest-105885354 None] Lock "cinder-c68f389f-f268-49ad-8163-5d91076a70e1-delete_volume" released by "delete_volume" :: held 4.902s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-243f74bd-60cc-45bd-a1ca-94e8d265c242-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-243f74bd-60cc-45bd-a1ca-94e8d265c242-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:40 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-243f74bd-60cc-45bd-a1ca-94e8d265c242" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-243f74bd-60cc-45bd-a1ca-94e8d265c242" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aeaa03-8d02-426f-bf2d-fd16747099cc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:40 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:41 devstack quobyte-client[83627]: System call of process 101104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242" returned: 0 in 0.564s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:41 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-243f74bd-60cc-45bd-a1ca-94e8d265c242" returned: 0 in 0.143s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:41 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-243f74bd-60cc-45bd-a1ca-94e8d265c242" released by "delete_volume" :: held 1.064s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:41 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['7fc24b18-bbe6-47ed-bbec-babb0d6fd717', '7be5ddcf-a633-40a3-8fec-7a88b5109142', 'a778fd7d-b7af-4618-a08b-5c2db38c4cfa', '6d0e07fc-df3e-4832-997b-1b3306714654'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.138s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:42 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-4b2e4bad-6457-4897-a820-146698f41c37-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:42 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-4b2e4bad-6457-4897-a820-146698f41c37-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-475689a7-77bb-4e4f-bfb6-fa84f2fc9267 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-243f74bd-60cc-45bd-a1ca-94e8d265c242-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:43 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-4b2e4bad-6457-4897-a820-146698f41c37" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-4b2e4bad-6457-4897-a820-146698f41c37" acquired by "delete_volume" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7bb438-355a-4136-a5b9-900cb978f8de]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:43 devstack quobyte-client[83627]: System call of process 101109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:43 devstack quobyte-client[83627]: System call of process 101109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37" returned: 0 in 0.491s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:43 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4b2e4bad-6457-4897-a820-146698f41c37" returned: 0 in 0.122s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-4b2e4bad-6457-4897-a820-146698f41c37" released by "delete_volume" :: held 0.853s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:44 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Flow 'volume_create_manager' (28e5353b-5cb7-47ae-9bd2-789d68afb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413bbc6f-b5e0-4ea2-89dc-16379ef7f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413bbc6f-b5e0-4ea2-89dc-16379ef7f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1682444039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f935d-e846-4fc5-ad51-1f8afa4413b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da1c0c8795a4fbe9d25bbb80b695503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:44Z,use_quota=True,user_id='8e7df5dd26e54b3f8e9f1d39be2e9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19b5865-4052-4ffc-9c52-e465a353ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19b5865-4052-4ffc-9c52-e465a353ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf0b6bc-9ace-4ad6-ba50-171413b3d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf0b6bc-9ace-4ad6-ba50-171413b3d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231f935d-e846-4fc5-ad51-1f8afa4413b3', 'volume_name': 'volume-231f935d-e846-4fc5-ad51-1f8afa4413b3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f94775-cdbd-4630-9b4e-1951b6e45755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f94775-cdbd-4630-9b4e-1951b6e45755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36a2bc-fe82-435e-8fa1-8a0918829fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:44 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Volume 231f935d-e846-4fc5-ad51-1f8afa4413b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231f935d-e846-4fc5-ad51-1f8afa4413b3', 'volume_size': 1} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1682444039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f935d-e846-4fc5-ad51-1f8afa4413b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da1c0c8795a4fbe9d25bbb80b695503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:44Z,use_quota=True,user_id='8e7df5dd26e54b3f8e9f1d39be2e9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)}" {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Creating volume 231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:44 devstack cinder-volume[83624]: INFO cinder.volume.drivers.remotefs [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] casted to 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 1073741824 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:44 devstack quobyte-client[83627]: System call of process 101113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:44 devstack quobyte-client[83627]: System call of process 101113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:44 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=170, name=volume-231f935d-e846-4fc5-ad51-1f8afa4413b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 1073741824" returned: 0 in 0.399s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:44 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['47ec10b1-edb1-4a37-98cc-dec12fe6781e', 'fd2f6c6c-0591-423c-b666-fafaee906bd4', '4add49da-a792-460f-9730-cff50b255bfd', 'eab0ef38-1c6a-4ff7-bae6-cf5ba611de4e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.441s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] <== create_volume: return (873ms) {'provider_location': '10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'} {{(pid=83624) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36a2bc-fe82-435e-8fa1-8a0918829fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231f935d-e846-4fc5-ad51-1f8afa4413b3', 'volume_size': 1}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d4b1bb-e8b5-483b-acef-2e3ccd6f92d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:45 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Volume volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 (231f935d-e846-4fc5-ad51-1f8afa4413b3): created successfully Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d4b1bb-e8b5-483b-acef-2e3ccd6f92d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Flow 'volume_create_manager' (28e5353b-5cb7-47ae-9bd2-789d68afb729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.366s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-f693c68d-c625-4dbf-87c1-9e1d93e39680 tempest-SnapshotDependencyTests-296810760 None] Created volume successfully. Sep 26 18:04:45 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:04:45 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-7a591863-af0e-4744-9905-69ecc78d0e72 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-4b2e4bad-6457-4897-a820-146698f41c37-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-4ddf30bc-fe79-45bd-9bca-498305879df5-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-4ddf30bc-fe79-45bd-9bca-498305879df5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:46 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-4ddf30bc-fe79-45bd-9bca-498305879df5" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-4ddf30bc-fe79-45bd-9bca-498305879df5" acquired by "delete_volume" :: waited 0.012s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdf0ba-2807-48aa-bac4-eb274af0bbad]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:46 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:46 devstack quobyte-client[83627]: System call of process 101118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5" returned: 0 in 0.605s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:47 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-4ddf30bc-fe79-45bd-9bca-498305879df5" returned: 0 in 0.356s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Creating offline snapshot 39403f25-8318-4290-9162-a405d5ef7e65 of volume 231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d39c13f-c84d-44a3-9cc8-148842ee5a35]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-4ddf30bc-fe79-45bd-9bca-498305879df5" released by "delete_volume" :: held 1.211s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:47 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['26073403-0de4-46ba-873f-bbe4d5d70706', '84f0b6f0-a3f4-4761-8a9a-f735ea0062b9', 'a35bb5e3-b238-4cec-a503-ba25a004620c', '187834f7-952d-4504-87a3-53e62787b94e'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:48 devstack quobyte-client[83627]: System call of process 101122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:48 devstack quobyte-client[83627]: System call of process 101122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.646s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 1G {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:48 devstack quobyte-client[83627]: System call of process 101125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:48 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=171, name=volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 1G" returned: 0 in 0.318s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): qemu-img rebase -u -b volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.235s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:48 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "qemu-img rebase -u -b volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 -F qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.511s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:04:48 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-09b401d2-bfbf-4909-948a-6f698975b309 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-4ddf30bc-fe79-45bd-9bca-498305879df5-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.333s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Setting permissions: /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 -> 1000:1000 {{(pid=83624) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.302s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:49 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:49 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.info" returned: 0 in 0.358s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.info is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.info {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" acquired by "delete_volume" :: waited 0.203s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.info" returned: 0 in 0.205s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4f2be-f520-4c59-bb28-2e90f38f864a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:50 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:50 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d0933bed-2fe4-4cd8-a0d2-dd1a5ad0386a tempest-SnapshotDependencyTests-296810760 None] Create snapshot completed successfully Sep 26 18:04:50 devstack quobyte-client[83627]: System call of process 101137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" returned: 0 in 0.529s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac" released by "delete_volume" :: held 1.038s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['5e9674b9-2a87-483e-93b6-dc78db07c047', 'b77e061c-edb8-4d2c-811b-13448d8699d4', '4bf34861-3a06-4971-bb52-a0d94e6d397f', '6d347f3a-6c06-450e-a114-7717703ab919'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:51 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.341s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-e7d26f5c-b341-47ca-b8ab-74187d9b4067-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:52 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:04:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83624) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-e7d26f5c-b341-47ca-b8ab-74187d9b4067-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Flow 'volume_create_manager' (0fc3a6f2-b684-4808-af70-fec1a3672faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f00372-aae9-4c77-b500-6fc4a6096e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-aa085ef5-8562-4729-a7f6-96c2bd4fd28a tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-2e4c0ff0-4398-4ccc-9389-fa18cf96b3ac-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f00372-aae9-4c77-b500-6fc4a6096e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-26T16:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a17156-5977-4d45-9644-e6e86fa7ec0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da1c0c8795a4fbe9d25bbb80b695503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-26T16:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39403f25-8318-4290-9162-a405d5ef7e65,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-26T16:04:52Z,use_quota=True,user_id='8e7df5dd26e54b3f8e9f1d39be2e9049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee84d5ec-ac08-45f4-b60c-6098e85863bc),volume_type_id=ee84d5ec-ac08-45f4-b60c-6098e85863bc)' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef03649-11a2-4953-961f-554d78eee94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef03649-11a2-4953-961f-554d78eee94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a59995f-d938-47fa-ad76-121705f7086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a59995f-d938-47fa-ad76-121705f7086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12a17156-5977-4d45-9644-e6e86fa7ec0e', 'volume_name': 'volume-12a17156-5977-4d45-9644-e6e86fa7ec0e', 'volume_size': 1, 'snapshot_id': '39403f25-8318-4290-9162-a405d5ef7e65'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76641b4f-53bd-43f9-9272-fc972e58690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76641b4f-53bd-43f9-9272-fc972e58690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc21fd46-dd79-47c0-bfd0-c512a121553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:04:52 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Volume 12a17156-5977-4d45-9644-e6e86fa7ec0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12a17156-5977-4d45-9644-e6e86fa7ec0e', 'volume_size': 1, 'snapshot_id': '39403f25-8318-4290-9162-a405d5ef7e65'} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65-12a17156-5977-4d45-9644-e6e86fa7ec0e" by "_create_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65-12a17156-5977-4d45-9644-e6e86fa7ec0e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Creating volume 12a17156-5977-4d45-9644-e6e86fa7ec0e from snapshot 39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Selected 10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb as target Quobyte volume. {{(pid=83624) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" by "_copy_volume_from_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] snapshot: 39403f25-8318-4290-9162-a405d5ef7e65, volume: 12a17156-5977-4d45-9644-e6e86fa7ec0e, {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:52 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-e7d26f5c-b341-47ca-b8ab-74187d9b4067" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d264366-c665-48b2-b94a-8dea42bf5e5f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-e7d26f5c-b341-47ca-b8ab-74187d9b4067" acquired by "delete_volume" :: waited 0.265s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c827d-daaa-41fa-abc0-0eeb5204e82f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:52 devstack quobyte-client[83627]: System call of process 101142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:52 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.537s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231f935d-e846-4fc5-ad51-1f8afa4413b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Creating direct copy from snapshot {{(pid=83624) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc37f913-8ca2-4424-ac0b-e6d9ed0b6eb4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:53 devstack quobyte-client[83627]: System call of process 101143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067" returned: 0 in 0.516s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-e7d26f5c-b341-47ca-b8ab-74187d9b4067" returned: 0 in 0.215s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-e7d26f5c-b341-47ca-b8ab-74187d9b4067" released by "delete_volume" :: held 0.899s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:53 devstack quobyte-client[83627]: System call of process 101146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.698s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG cinder.utils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e not found in is_blk_device check {{(pid=83624) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 26 18:04:53 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:53 devstack quobyte-client[83627]: System call of process 101152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:54 devstack quobyte-client[83627]: The server volume:9ed423de-bfc5-490b-99b8-d6b480cd0db4@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=9ed423de-bfc5-490b-99b8-d6b480cd0db4, inode=173, name=volume-12a17156-5977-4d45-9644-e6e86fa7ec0e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.210), requestorAccessMask=0 Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['b4b44072-224e-4cf7-b662-74a62f7c3633', '9ce07717-d3ba-4615-9145-83b5cdd21d02', 'cc979e63-d1ff-462a-95c4-a080f876af42', '0c9770a6-9e27-4073-b9c4-44d5444256d6'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:04:54 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:55 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.350s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:55 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:04:55 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:04:55 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-af2f2668-f1b2-4294-9a42-b120df75c2c4 tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-e7d26f5c-b341-47ca-b8ab-74187d9b4067-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-b159b6d1-5c92-4035-91bb-8368b67cd604-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-b159b6d1-5c92-4035-91bb-8368b67cd604-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:56 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "cinder-quobyte-b159b6d1-5c92-4035-91bb-8368b67cd604" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-b159b6d1-5c92-4035-91bb-8368b67cd604" acquired by "delete_volume" :: waited 0.038s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9feb9ce-d321-4f03-a2d2-3d4f76ef8323]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:56 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:58 devstack quobyte-client[83627]: System call of process 101163 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:04:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604" returned: 0 in 1.237s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:58 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-b159b6d1-5c92-4035-91bb-8368b67cd604" returned: 0 in 0.206s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:59 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-quobyte-b159b6d1-5c92-4035-91bb-8368b67cd604" released by "delete_volume" :: held 2.159s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:04:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e" returned: 0 in 5.487s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:04:59 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aebcf11-7b0d-448b-8a71-2a510ff53694]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:04:59 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:04:59 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Created reservations ['4619e1c1-bd8f-4ed7-8a67-70e2bf308383', '81b41c0a-b5aa-4986-a4a1-1d5bab08a572', 'ba004656-e17e-49d7-94fd-cae22e5bdd73', 'aa4c434d-515a-4a4d-a064-d3867e17fe73'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.813s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.image.image_utils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Image conversion details: src /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e {{(pid=83624) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 26 18:05:00 devstack cinder-volume[83624]: INFO cinder.image.image_utils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Converted 1024.00 MB image at 186.03 MB/s Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] File path /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e is being set with permissions: 660 {{(pid=83624) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.199s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:05:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Deleted volume successfully. Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e" returned: 0 in 0.336s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" released by "_copy_volume_from_snapshot" :: held 8.199s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-c7d217fe-2be4-486d-a929-e06df4da400d tempest-CreateVolumesFromSourceVolumeTest-1043281922 None] Lock "cinder-b159b6d1-5c92-4035-91bb-8368b67cd604-delete_volume" released by "delete_volume" :: held 4.408s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65-12a17156-5977-4d45-9644-e6e86fa7ec0e" released by "_create_volume_from_snapshot" :: held 8.257s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.277s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc21fd46-dd79-47c0-bfd0-c512a121553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a17156-5977-4d45-9644-e6e86fa7ec0e', 'volume_size': 1, 'snapshot_id': '39403f25-8318-4290-9162-a405d5ef7e65'}' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6475ce-6485-418f-a144-f8bf910df86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 26 18:05:00 devstack cinder-volume[83624]: INFO cinder.volume.flows.manager.create_volume [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Volume volume-12a17156-5977-4d45-9644-e6e86fa7ec0e (12a17156-5977-4d45-9644-e6e86fa7ec0e): created successfully Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6475ce-6485-418f-a144-f8bf910df86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83624) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 26 18:05:00 devstack cinder-volume[83624]: DEBUG cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Flow 'volume_create_manager' (0fc3a6f2-b684-4808-af70-fec1a3672faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83624) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 26 18:05:00 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-6a28af9c-4c95-45ef-8bef-39e7524f4aaa tempest-SnapshotDependencyTests-296810760 None] Created volume successfully. Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-39403f25-8318-4290-9162-a405d5ef7e65-delete_snapshot" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-39403f25-8318-4290-9162-a405d5ef7e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:01 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" by "delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65" by "_delete_snapshot" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Deleting offline snapshot 39403f25-8318-4290-9162-a405d5ef7e65 of volume 231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] snapshot_file for this snap is: volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed8986-745d-4c69-8025-4b1b857fc474]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.479s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.remotefs [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231f935d-e846-4fc5-ad51-1f8afa4413b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83624) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08cd2c6-c99e-491d-a25b-535c306900a6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:05:01 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:02 devstack quobyte-client[83627]: System call of process 101182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.464s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:02 devstack quobyte-client[83627]: System call of process 101185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.210s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3.39403f25-8318-4290-9162-a405d5ef7e65" returned: 0 in 0.087s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-39403f25-8318-4290-9162-a405d5ef7e65" released by "_delete_snapshot" :: held 1.556s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:02 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" released by "delete_snapshot" :: held 1.589s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Created reservations ['e04bbc76-4191-4d61-9326-0b60ab317a1a', '3884b87b-8bba-4a44-b6f9-1cd3c62e31c1', 'e7927e7d-c89a-4c54-a7d5-e06ef3108f79', '8f90c6ff-131f-43ec-a583-c0d389e2ac18'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:05:03 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Delete snapshot completed successfully. Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-995f7500-abc3-4786-a965-68faaed47c78 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-39403f25-8318-4290-9162-a405d5ef7e65-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-231f935d-e846-4fc5-ad51-1f8afa4413b3-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-231f935d-e846-4fc5-ad51-1f8afa4413b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:03 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" acquired by "delete_volume" :: waited 0.013s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd848c-11e1-4c3c-b49e-0ebfffed191f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:05:03 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:03 devstack quobyte-client[83627]: System call of process 101189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.402s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3 {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-231f935d-e846-4fc5-ad51-1f8afa4413b3" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-231f935d-e846-4fc5-ad51-1f8afa4413b3" released by "delete_volume" :: held 0.699s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Created reservations ['cda017d4-490b-43dd-8f63-2e8e70e8da18', '665842d6-9d28-4434-9882-8654a84e8864', 'c92dc0d0-4de7-4d61-bd80-f2700eb0d9d7', '9764d3b5-d6d4-466c-9298-92de3b58e927'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.114s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:04 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:05:04 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Deleted volume successfully. Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-d2962668-3839-4cb8-a939-0d9231fdba20 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-231f935d-e846-4fc5-ad51-1f8afa4413b3-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-12a17156-5977-4d45-9644-e6e86fa7ec0e-delete_volume" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-12a17156-5977-4d45-9644-e6e86fa7ec0e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:05 devstack cinder-volume[83624]: WARNING cinder.volume.volume_utils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" by "delete_volume" {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" acquired by "delete_volume" :: waited 0.011s {{(pid=83624) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG oslo.privsep.daemon [-] privsep: reply[45491c7d-e1c6-433c-b210-3905747b018e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 26 18:05:05 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e" returned: 0 in 0.370s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] CMD "rm -f /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a/volume-12a17156-5977-4d45-9644-e6e86fa7ec0e" returned: 0 in 0.116s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-quobyte-12a17156-5977-4d45-9644-e6e86fa7ec0e" released by "delete_volume" :: held 0.646s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG cinder.quota [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Created reservations ['f0533172-60bc-462f-8612-c244b0a6a017', 'bc0ae848-3059-4788-a305-a1847ca5015a', '19b647ba-bda1-482e-aac8-375e36ea45f1', '219c9037-8b7a-4366-a025-2acc5cbe5863'] {{(pid=83624) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:05:06 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:07 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.106s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:07 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:05:07 devstack cinder-volume[83624]: INFO cinder.volume.manager [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Deleted volume successfully. Sep 26 18:05:07 devstack cinder-volume[83624]: DEBUG cinder.coordination [None req-57815ada-dc37-4c69-a848-33b512beacd6 tempest-SnapshotDependencyTests-296810760 None] Lock "cinder-12a17156-5977-4d45-9644-e6e86fa7ec0e-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83624) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG oslo_service.periodic_task [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83624) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb': None} {{(pid=83624) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG cinder.volume.drivers.quobyte [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Available shares ['10.10.41.181/cinder-vol-e70f520d-6ca6-443b-b90c-0293d90fd6cb'] {{(pid=83624) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.lockutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83624) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 26 18:05:09 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 26 18:05:10 devstack cinder-volume[83624]: DEBUG oslo_concurrency.processutils [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/f02bd820fc68bf491f1b77773bc9020a" returned: 0 in 0.097s {{(pid=83624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 26 18:05:10 devstack cinder-volume[83624]: DEBUG cinder.manager [None req-0da96005-4efd-44ca-a8fc-f065aa16feee None None] Notifying Schedulers of capabilities ... {{(pid=83624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 26 18:05:16 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=76,cinder:UPDATE=111,cinder:INSERT=21,cinder:DELETE=8 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 26 18:05:17 devstack cinder-volume[83624]: DEBUG dbcounter [-] [83624] Writing DB stats cinder:SELECT=65,cinder:DELETE=12,cinder:UPDATE=105,cinder:INSERT=27 {{(pid=83624) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}